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(54) Edited image printing system and method 

(57) A user obtains a high-quality edited image in 
comparatively simple fashion without going to a 
processing laboratory. A image editing apparatus 1 , a 
main server 30, an image server 31 and a printer server 
32 are interconnected via a network so as to be capable 
of communicating with one another The user generates 
an edited image from a plurality of images using the im- 
age editing apparatus 1 . Editing information, which is for 
reproducing the edited image that has been generated, 



is transmitted from the image editing apparatus 1 to the 
main server 30. On the basis of the received editing in- 
formation, the main server 30 retrieves image data, 
which is used in generating the edited image, stored in 
the main server 30 or in an image server 31, and gen- 
erates edited image data. The edited image data that 
has been generated is transmitted to the printer server 
32, which proceeds to print a high-quality edited image. 
The finished product, namely the edited image, it mailed 
to the user of the image editing apparatus 1. 
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Description 

This invention relates to a system and image com- 
munication method wherein an image editing appara- 
tus, an image server and a printer server are capable of 
communicating with one another. The present invention 
relates further to the image editing apparatus, image 
server and printer server that construct this system, and 
to a recording medium for the communication of image 
data. 

The development of personal computers has made 
it possible for a user to input images to his or her own 
computer, perform image editing using a plurality of im- 
ages and produce one desired frame of an image. In a 
case where one frame of the edited image is printed, the 
usual practice is to employ a printer located in the user's 
own home. 

The printer at the user's home, however, generally 
is inexpensive and therefore the image quality of the ed- 
ited image printed often is not good. In order to obtain 
a high-quality print image, the medium (a floppy disk or 
the like) on which the image data representing the edited 
image has been recorded must be taken to a processing 
laboratory having a special-purpose printing apparatus 
and the image must be printed at the laboratory 

Depending upon the user, going to a processing 
laboratory to obtain a high-quality edited image may be 
too troublesome. 

An object of the present invention is to so arrange 
it that a high-quality edited image can be printed com- 
paratively simply. 

The present invention provides an edited image 
printing method in an image communication system in 
which an image server, an image editing apparatus and 
a printer server are capable of communicating with one 
another. 

The image editing apparatus generates an edited 
image of one Irame using image data representing im- 
ages of at least two frames and transmits information, 
which relates to generation of the edited image, to the 
image server. 

The image server generates editedjmage data, 
which represents the edited image, basecfupon the in- 
formation relating to generation of the edited image 
transmitted from the image editing apparatus, and trans- 
mits the edited image data that has been generated to 
the printer server. 

The printer server prints the edited image using the 
edited image data transmitted from the image server. 

The present invention provides also an image com- 
munication system suited to implementation of the ed- 
ited image printing method mentioned above. The im- 
age communication system is a system in which the im- 
age server, the image editing apparatus and the printer 
server are capable of communicating with one another. 

The image editing apparatus has image editing 
means for generating an edited image of one frame us- 
ing image data representing images of at least two 



frames, and information transmitting means for trans- 
mitting, to the image server, information relating to gen- 
eration of the edited image generated by the image ed- 
iting means. 

s The image server has edited image data generating 
means for generating edited image data, which repre- 
sents the edited image, based upon the information re- 
lating to generation of the edited image transmitted from 
the image editing apparatus, and edited image data 

10 transmitting means for transmitting, to the printer server, 
the edited image data generated by the edited image 
data generating means. 

The printer server has printing means for printing 
the edited image using the edited image data transmit- 

75 ted from the image server 

In accordance with the present invention, an edited 
image is generated in the image editing apparatus, 
which usually is located at the user's home. The infor- 
mation relating to generation of the edited image is 

20 transmitted from the image editing apparatus to the im- 
age server. 

Edited image data representing the edited image is 
generated in the image server based upon the informa- 
tion relating to generation of the edited image transmit- 
25 ted from the image editing apparatus, and the edited im- 
age data is transmitted from the image server to the 
printer server. 

The edited image represented by the edited image 
data transmitted from the image server is printed by the 
30 printer server. 

The printer server has a printing apparatus capable 
of high-quality printing, and printing of the edited image 
is carried out using this printing apparatus. 

The edited image printed at the printer server would 
35 be delivered to the user of the image editing apparatus 
by cash on delivery (C.O.D.) mail, by way of example. 
The user of the image editing apparatus need not go to 
a processing laboratory but can acquire a high-quality 
edited image (the product) while remaining at home. 
40 Several methods for generating the edited image 
are available. These will now be described. 

A first method can be applied when image data rep- 
resenting images of a plurality of frames has been 
stored in the image server. The method includes trans- 
45 mining image data, which represents images of at least 
two frames from among the images of the plurality of 
frames, from the image server to the image editing ap- 
paratus based upon a transmission command from the 
image editing apparatus, and generating the aforemen- 
50 tioned edited image of one frame in the image editing 
apparatus using image data representing the images of 
at least two frames transmitted from the image server. 

In this case, the image editing apparatus transmits 
image identification information for specifying the image 
55 data and information relating to editing of the edited im- 
age to the image server. 

Image data corresponding to the images of at least 
two frames stored at the image server is retrieved in the 
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image server based upon the image identification infor- 
mation, and edited image data representing the edited 
image is generated in the image server based upon the 
retrieved image data and the information relating to the 
editing of the edited image. 

The image editing apparatus or image server may 
be arranged independently in the image communication 
system. Further, a recording medium on which a pro- 
gram for operating the image editing apparatus and im- 
age server in the manner set forth above has been re- 
corded may be created. 

The image data representing the images of at least 
two frames among the images of the plurality of frames 
is transmitted Irom the image server to the image editing 
apparatus based upon a transmission command from 
the image editing apparatus. 

The user generates the edited image of one frame 
using the image data that has been transmitted from the 
image server. When the edited image is generated, the 
image editing apparatus transmits information relating 
to this editing and image identification information for 
specifying the images used in generation of the edited 
image to the image server. 

On the basis of the image identification information, 
image data representing the images used in generation 
of the edited image is retrieved at the image server. 
When this image data is retrieved, the image server gen- 
erates the edited image data based upon the retrieved 
image data and the information relating to editing. 

The edited image data is supplied from the image 
server to the printer server, which proceeds to print the 
edited image. 

A second method can be applied when first image 
data used in image editing has been stored in the image 
server and second image data used in image editing has 
been stored in the image editing apparatus. The first im- 
age data is transmitted from the image server to the im- 
age editing apparatus based upon a transmission com- 
mand from the image editing apparatus, and an edited 
image of one frame is generated in the image editing 
apparatus using the first image data transmitted from 
the image server and the second image data that has 
been stored in the image editing apparatus. 

Information relating to editing ol the edited image, 
image identification information for specifying the first 
image data and the second image data used in the gen- 
eration of the edited image are transmitted from the im- 
age editing apparatus to the image server. 

The first image data that has been stored in the im- 
age server is retrieved at the image server based upon 
the image identification information, and the image serv- 
er generates edited image data representing the edited 
image based upon the first image data that has been 
retrieved, the second image data that has been trans- 
mitted from the image editing apparatus and the infor- 
mation relating to generation of the edited image. 

The image server or image editing apparatus con- 
structing the image editing system may each be ar- 



ranged independently. Further, a recording medium on 
which a program for operating the image editing appa- 
ratus and image server in the manner set lorth above 
has been recorded may be created. 
5 The first image data is transmitted from the image 
server to the image editing apparatus. 

The image editing apparatus generates the edited 
image using the first image data transmitted from the 
image server and the second image data that has been 
w stored. 

The information relating to generation of the edited 
image, the image identification information for specify- 
ing the first image data and the second image data used 
in generation of the edited image are transmitted from 
is the image editing apparatus to the image server. 

The first image data is retrieved in the image server 
from the image identification information, and the image 
server generates the edited image data from the first im- 
age data that has been retrieved, the second image data 
20 transmitted (rom the image editing apparatus and the 
information relating to generation of the edited image. 

The edited image data that has been generated is 
transmitted to the printer server, which proceeds to print 
the edited image. 
25 Thus, the edited imago can be generated using the 
second image data that has been stored in the image 
editing apparatus. 

Since the edited image can be generated using im- 
age data that has not been stored in the image server, 
30 an edited image desired by the user of the image editing 
apparatus can be generated freely. 

In this case also the user of the image editing ap- 
paratus can obtain a printed high-quality edited image 
without going to a processing laboratory. 
35 A third method can be applied when first image data 
representing images of a plurality of frames has been 
stored in the image server and second image data used 
in image editing has been stored in the image editing 
apparatus. Specific first image data, which represents 
40 an image of at least one frame among the images of the 
plurality of frames, is transmitted from the image server 
to the image editing apparatus, and the image editing 
apparatus generates the edited image of one frame us- 
ing the specific first image data transmitted from the im- 
45 age server and the second image data that has been 
stored in the image editing apparatus. 

Information relating to editing of the edited image 
and image identification information for specifying the 
specific first image data as well as the second image 
50 data is transmitted from the image editing apparatus to 
the image server. 

On the basis of the image identification information, 
the image server retrieves the specific first image data 
and second image data from the image data that has 
55 been stored in the image server, and the image server 
generates edited image data representing the edited im- 
age based upon the retrieved specific first image data 
and second image data and the image identification in- 
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formation. 

The image server or image editing apparatus con- 
structing the image editing system may each be ar- 
ranged independently. Further, a recording medium on 
which a program tor operating the image editing appa- 5 
ratus and image server in the manner set forth above 
has been recorded may be created. 

The specific first image data is transmitted from the 
image server to the image editing apparatus. The sec- 
ond image data has been stored in the image editing 10 
apparatus, which generates the edited image using the 
specific first image data and second image data. 

The image editing apparatus transmits the informa- 
tion relating to generation of the edited image and the 
image identification information to the image server. The is 
image server retrieves the specific first image data and 
second image data based upon the image identification 
information. 

The edited image data is generated Irom the spe- 
cific first image data and second image data retrieved 20 
and the information relating to generation of the edited 
image. The edited image data is transmitted to the print- 
er server, whereby the edited image is printed. 

Thus, the user of the image editing apparatus can 
obtain a high-quality edited image without going to a 2s 
processing laboratory. 

Since the second image data need not be transmit- 
ted from the image editing apparatus to the image serv- 
er, the time required for the transmission from the image 
editing apparatus to the image server can be shortened. 30 

A fourth method can be applied when image data 
representing images of a plurality of mutually corre- 
sponding frames have been stored in the image server 
and image editing apparatus. The image editing appa- 
ratus generates an edited image of one frame using im- 35 
ages of at least two frames from among a plurality of 
images represented by the image data that has been 
stored in the image editing apparatus. 

The image editing apparatus transmits information 
relating to editing of the edited image and image identi- *o 
fication information, which is for specifying images of at 
least two frames used in generation of the edited image, 
to the image server. 

On the basis of the image identification information, 
the image server retrieves image data representing im- 45 
ages of at least two frames used in generation of the 
edited image Irom image data that has been stored in 
the image server, and the image server generates the 
edited image from the retrieved image data, which rep- 
resents images corresponding to the images of at least 50 
two frames, and the image identification information. 

The image editing apparatus and image server con- 
structing the image editing system may each be ar- 
ranged independently. Further, a recording medium on 
which a program for operating the image editing appa- 55 
ratus and image server in the manner set forth above 
has been recorded may be created. 

An edited image of one frame is generated using 



image data representing images of at least two frames 
stored in the image editing apparatus. The image editing 
apparatus transmits the information relating to genera- 
tion of the edited image and the image identification in- 
formation to the image server. On the basis of the image 
identification information, the image server retrieves the 
image data used in generation of the edited image. The 
printer server prints the edited image based upon the 
retrieved image data and the information relating to gen- 
eration of the edited image. 

Thus, the user of the image editing apparatus can 
obtain a printed, high-quality edited image without going 
to a processing laboratory. 

In this case, the edited image can be generated, 
even in a case where the image server does not have 
the desired image, using the images that have been 
stored in the image editing apparatus. Moreover, since 
the information relating to generation of the edited im- 
age and the image identification information is transmit- 
ted to the image server but image dala is not, rapid 
transmission is possible. 

It is preferred that the image data for generation of 
the edited image be reduced-image (thumbnail image) 
data, which represents an image of reduced size, when 
the image data for generation of the edited image is 
transmitted from the image server to the image editing 
apparatus in order to generate the edited image. 

Further, the edited image data is generated in the 
image server using printing image data having a reso- 
lution higher than that of the thumbnail image data. 

Since the image data transmitted to the image ed- 
iting apparatus is indicative of an image of reduced size, 
the quantity of data is small and the data can be trans- 
mitted rapidly. Since image data for printing having a 
resolution higher than that of the thumbnail data is used 
as the image data for editing, the printing of a high-qual- 
ity edited image can be maintained. 

It is preferred that the image data be transmitted to 
the image editing apparatus upon transmitting an au- 
thentication code from the image editing apparatus to 
the image editing apparatus and determining, on the ba- 
sis of the authentication code, whether the transmission 
of the image data is permitted. Thi% makes it possible 
for the image data to be used only by a specific user. 

In a case where there are a plurality of image serv- 
ers that are capable of communicating with the image 
editing apparatus, retrieval processing would be execut- 
ed in the other image servers when image data has not 
been retrieved by the above-described retrieval 
processing. 

In a case where the image data is such that pay- 
ment of a royalty is required, based upon a copyright, 
for example, for use of the image data, it is determined 
whether the image data retrieved by the retrieval 
processing is indicative of an image requiring billing. In 
case of image data requiring billing, information relating 
to billing is related with the edited image data and the 
information relating to billing is stored in the image serv- 
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er and printer server. Since the information relating to 
billing is related with the edited image data, the user of 
the image editing apparatus can be notified that an im- 
age required billing is used and that a charge is being 
billed in a case where the edited image is printed and 
sent to the user of the image editing apparatus. 

There are instances where printing of an edited im- 
age cannot be performed by the printer server owing to 
a printer server malfunction. In such case information 
relating to suspension of printing of the edited image is 
transmitted to either or both of the image editing appa- 
ratus and image server 

Either the user of the image editing apparatus or the 
operator of the image server or both can be notified of 
suspension ol printing. If necessary, printing may be 
performed by another printer server and the use ot the 
image editing apparatus can be so informed. 

In a case where printing of the edited image is sus- 
pended, the information relating to billing that has been 
stored in the image server and printer server is deleted. 

In a case where an edited image includes an image 
requiring billing and the fee for this image has been col- 
lected from the user of the image editing apparatus, an 
indication to this effect is stored in the image server and 
printer server. The information relating to billing may be 
deleted. 

By accepting a fee for using the image server, infor- 
mation relating to such acceptance may be transmitted 
from the image server to the printer server. As a result, 
the operator of the printer server is capable of being no- 
tified that the operator of the image server accepted the 
fee for use of the image server. 

Further, by accepting a fee for using the printer serv- 
er, information relating to such acceptance may be 
transmitted from the printer server to the image server 
As a result, the operator of the image server is capable 
of being notified that the operator of the printer server 
accepted the fee for use of the image server. 

It is preferred that the information relating to fee ac- 
ceptance be transmitted upon being encrypted. This 
makes it possible to prevent interception by another par- 
ty. 

The image data may be stored on a portaBte stor- 
age medium (a medium, such as a floppy disk or CD- 
ROM, that may be freely carried about). In such case 
the image data would be read out of the medium and 
stored in the image editing apparatus. It is preferred that 
the image data stored on the portable storage medium 
be thumbnail image data representing images ol re- 
duced size. This will make it possible to perform image 
editing using the edited image data as is (i.e., without 
sub-sampling the data). Since the quantity of data will 
be small, a great deal of data can be stored on the port- 
able storage medium. 

It may be so arranged that data other than image 
data requiring billing is stored on the portable storage 
medium. Since image data other than image data re- 
quiring billing is the object of the retrieval operation de- 



scribed above, it is unnecessary to judge whether billing 
is required or not. 

The image server and printer server may be made 
the same apparatus in the description given below. 
5 it can also be so arranged that when image data for 

generating the edited image is generated by the user of 
the image editing apparatus, the image data for gener- 
ating the edited image is stored in the image server and 
the user of the generated image data for generating the 
10 edited image is requested to pay a fee for use. 

In this case, the image data for generating the ed- 
ited image data and information relating to the charge 
that corresponds to this image data for generating the 
edited image are transmitted from the image editing ap- 
is paratus to the image server. 

The image server stores the image data for gener- 
ating the edited image and the information relating to 
billing that corresponds to this image data for generating 
the edited image, and relates the corresponding inlor- 
20 mation relating to billing with the edited image data ow- 
ing to the fact that the edited image data has been gen- 
erated using the image data for generating the edited 
image. 

On the basis of the information relating to billing that 
2S has been added onto the edited image data, a use fee 
can be collected from the user of the image data for gen- 
erating the edited image. 

The information relating to billing corresponding to 
the image data for generating the edited image may be 
30 made capable of modification. In such case the modified 
information relating to billing is related with the edited 
image data. 

The fee for use of the image data for generating the 
edited image can be modified in dependence upon the 
35 mode of use of the image represented by the image data 
for generating the edited image. For example, in a case 
where an image represented by the image data for gen- 
erating the edited image is utilized in an enlarged state, 
a high user's fee is set. If the image is utilized in a re- 
40 duced state, a low user's fee is set. 

The image data representing an image of one frame 
from images of at least two frames may be template im- 
age data representing the background of an image con- 
stituting the edited image. This makes it possible to edit 
45 images having various decorations. The user may be 
billed in regard to template image data as well. 

The image server may be adapted to count the 
number of limes the image data for generating the ed- 
ited image is used. The fee for using the image data for 
50 generating the edited image, which fee is decided by the 
information relating to billing that corresponds to image 
data for generating the edited image, is set so as to de- 
crease as the number of times the image data is used 
increases. 

55 This makes it possible to provide better service for 
users that make frequent use of the image data. 

In a case where an individual who has generated 
the image data for generating the edited image utilizes 
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self-generated image data for generating the edited im- 
age, it is preferred that the image data for generating 
the edited image be free of charge even if it is the object 
of biliing. In a case where an individual who is capable 
of using, free of charge, the image data for generating 
the edited image has been decided in advance and this 
individual has generated edited image data using the 
image data for generating the edited image, the opera- 
tion for relating the corresponding information relating 
to billing with the edited image data is stopped. 

In a preferred embodiment, an authentication serv- 
er (authentication station) is provided, the authentica- 
tion server determines whether the image editing appa- 
ratus, the image server and the printer server are legit- 
imate and enables communication among the image ed- 
iting apparatus, image server and printer server possi- 
ble by determining that they are legitimate. 

Thus, only a legitimate user is capable of perform- 
ing image editing. An individual having no right to use 
the image editing apparatus, image server and printer 
server can be prevented for using them. 

The image editing apparatus and printer server may 
be made the same apparatus. In such case the user can 
perform printing at home if the image editing apparatus 
is provided in the user's home. 

It is preferred that limitation data that limits the 
number of times an edited image represented by the ed- 
ited image data is printed be added onto the edited im- 
age data, and it is preferred that the printer server allow 
printing of the edited image up to the number of times 
which is the limit set by the limitation data. This makes 
it possible to prevent the edited image from being print- 
ed an unlimited number of times. This is especially use- 
ful when an image that is the object of billing is utilized 
as the edited image. 

It is preferred that data relating to the status of gen- 
eration of the edited image data in the image server be 
transmitted from the image server to the image editing 
apparatus. 

By virtue of the fact that the image editing apparatus 
receives the data relating to status of generation, the 
user of the image editing apparatus is capable of being 
notified (by a display on a screen^br by output of audio) 
of the status of generation. 

The edited image data generated by the image 
server may be transmitted to the image editing appara- 
tus. The image editing apparatus displays and prints the 
image represented by the received edited image data, 
as required. 

The edited image data may be transmitted to the 
image editing apparatus which has transmitted the ed- 
iting information etc. to the image server so that the im- 
age server generates the edited image, as well as to 
other image editing apparatuses. 

Further, a format of the generated edited image da- 
ta may be converted to a different format (to PostScript, 
HTML (Hyper Text Markup Language), PDF (Portable 
Document Format) and the like) in the image server. The 



possibility in which the user can obtain (the image edit- 
ing apparatus of the user accesses the image server to 
obtain the edited image data and displays the edited im- 
age on the display unit or prints the edited image by the 
5 printer to enable the user to see the edited image) the 
edited image represented by the edited image data be- 
comes high. 

The edited image data which has been subjected 
to format conversion may be transmitted to the image 

10 editing apparatus. In this case, it becomes possible that 
an image format is designated in the image editing ap- 
paratus and that the format of the edited image data is 
converted to the designated format in the image server 
Further, according to the present invention, an im- 

15 age communication system in which an image editing 
apparatus and printer server are capable of communi- 
cating with each other is characterized in that image da- 
ta representing images of a plurality of frames is stored 
in the image editing apparatus, an edited image of one 

20 frame is generated using image data representing im- 
ages of at least two frames from among the stored im- 
age data, edited image data representing the generated 
edited image is transmitted to the printer server, and the 
printer server prints the edited image using the edited 

25 image data that has been transmitted. 

The present invention provides also an edited im- 
age printing system suited to the edited image printing 
method described above. 

More specifically, the present invention provides an 

30 image communication system in which an image editing 
apparatus, which has image data storage means in 
which image data representing images of a plurality of 
frames has been stored, and a printer server are capa- 
ble of communicating with each other wherein the im- 

35 age editing apparatus has image editing means for gen- 
erating an edited image of one frame using image data 
representing images of at least two frames from among 
the image data that has been stored in the image data 
storage means, and edited image data transmitting 

40 means for transmitting the edited image data, which rep- 
resents the edited image generated by the image editing 
means, to the printer server, and the printer server has 
printing means for printing the edited image using the 
edited image data that has been transmitted. 

45 The image editing apparatus and printer server con- 
structing the edited image printing system may each be 
arranged independently. Further, a recording medium 
on which a program for operating the image editing ap- 
paratus and image server in the manner set forth above 

50 has been recorded may be created. 

In accordance with the present invention, the edited 
image data is created using the image data that has 
been stored in the image server. The edited image data 
that has been created is transmitted from the image ed- 

55 iting apparatus to the printer server. The edited image 
is printed by the printer server. 

Thus, in this aspect of the invention as well, the user 
of the image editing apparatus can obtaina high-quality, 
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printed edited image without going to a processing lab- 
oratory. 

In a case where the image data has been stored on 
a portable storage medium, it is possible to store the 
image data in the image editing apparatus by reading 
the image data out of the medium. In this case also the 
image data that has been stored on the portable storage 
medium preferably is reduced-image data. 

Other leatures and advantages of the present in- 
vention will be apparent from the following description 
of preferred embodiments of the present invention, giv- 
en by way of example only, taken in conjunction with the 
accompanying drawings, in which like reference char- 
acters designate the same or similar parts throughout 
the figures thereof, and in which: 

Fig. 1 is a diagram illustrating the overall configura- 
tion of an image communication system; 
Fig. 2 is a block diagram showing the electrical con- 
figuration of an image editing apparatus; 
Fig. 3 is a block diagram showing the electrical con- 
figuration of an image server; 

Fig. 4 is a block diagram showing the electrical con- 
figuration of a printer server; 

Fig. 5 is a diagram showing folders generated by a 
main server; 

Figs. 6 and 7 are diagrams showing an example of 
a free image: 

Fig. 8 is a diagram showing an example of a copy- 
right-protected image; 

Fig. 9 is a diagram showing an example ol a per- 
sonal image; 

Fig. 1 0 is a diagram showing an example of an ed- 
ited image; 

Fig. 11 is a diagram showing an example of a re- 
duced-image (thumbnail image) file; 
Figs. 12 and 13 are diagrams showing an example 
of an image file for printing purposes; 
Fig. 1 4 is a diagram showing an example of an ed- 
ited image file; 

Figs. 1 5 to 1 9 are diagrams showing an example of 
utilization of an image communication system; 
Figs. 20 to 25 are flowcharts illustrating image read- 
in processing; 

Figs. 26 and 27 are diagrams illustrating an exam- 
ple of a display on a screen; 

Figs. 28 to 36 are flowcharts illustrating image ed- 
iting processing and image output processing; 
Figs. 37 and 38 are diagrams illustrating an exam- 
ple of a display on a screen; 

Fig. 39 is a diagram showing an example of editing 
information; 

Figs. 40 and 41 are flowcharts of authentication 
processing; 

Fig. 42 to 45 are flowcharts of processing for ac- 
cepting order information and editing images; 
Fig. 46 is a flowchart of server-to-server communi- 
cation processing; 



Figs. 47 and 48 are flowcharts of printing process- 
ing; 

Fig. 49 is a flowchart of printing end processing; 
Figs. 50 to 52 are diagrams showing an example of 
a display screen on a display unit of the image ed- 
iting apparatus; 

Fig. 53 is a diagram showing an overview of a billing 
processing procedure; 

Figs. 54a - 54c are diagrams illustrating billing man- 
10 agement files; 

Fig. 55 is a diagram showing a billing management 
file; 

Figs. 56a and 56b illustrate component images; 
Fig. 57 is a diagram illustrating a template image; 
is Fig. 58 is a diagram showing an example of an im- 
age that has been stored in an image editing appa- 
ratus; 

Fig. 59 is a diagram showing an example of an ed- 
ited image; 

20 Fig. 60 is a flowchart of processing for billing lor reg- 
istration of component images; 
Fig. 61 is a diagram showing a component image 
registration file; 

Figs. 62a, 62b and 62c are diagrams showing com- 
2S poncnt image files; 

Fig. 63 is a flowchart illustrating template image 
generation processing; 

Figs. 64and 65 are flowcharts of processing for bill- 
ing for registration of a template image; 
30 Fig. 66 is a diagram showing a template image reg- 
istration file; 

Figs. 67a - 67c are diagrams illustrating template 
files; 

Fig. 68 is a flowchart illustrating image editing 

35 processing; 

Figs. 69 to 72 are flowcharts illustrating processing 
for billing for printing of an edited image; 
Fig. 73 illustrates a printing fee discount table; 
Fig. 74 illustrates an editing fee discount table; 

40 Fig. 75 illustrates a paper cost discount table; 
Fig. 76 illustrates a service category table; 
Fig. 77 is a diagram showing the content of a data- 
base; , n > 
Fig. 78 is a diagram illustrating processing tor ac- 

45 cepting payment; 

Fig. 79 is a diagram illustrating processing executed 

at occurrence of cancellation; 

Fig. 80 is a diagram illustrating an authentication 

procedure; 

so Fig. 81 is a diagram showing an example of a case 
where the image editing apparatus and printer serv- 
er are installed at the same location; 
Fig. 82 is a diagram showing a file of copyright-pro- 
tected images used; 

55 Fig. 83 is a diagram showing a copyright-protected 
image use list file; 

Fig. 84 is a diagram showing an example of a case 
where the image editing apparatus and printer serv- 
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er are installed at the same location; and 

Fig. 85 is a diagram showing an edited image file 

for printing. 

Fig. 86 is a flowchart illustrating printing an edited 
image in the image editing apparatus. 
Figs. 87 and 88 are diagrams showing an example 
of a screen displayed on a display unit of the image 
editing apparatus. 

Figs. 89 to 93 are flowcharts illustrating printing an 
edited image in the image editing apparatus. 

DESCRIPTION OF THE PREFERRED EMBODIMENT 

(1) Configuration of image communication system 

Fig. 1 illustrates the overall configuration of an im- 
age communication system embodying the present in- 
vention. 

The image communication system comprises a plu- 
rality of image editing apparatus 1 (only one of which is 
illustrated in Fig. 1), a main server 30, an image server 
31 and a printer server 32 interconnected via a network 
so as to be capable of communicating with one another. 
(Though the main server 30 and image server 31 are 
the same, here they have different names and reference 
characters for reasons of convenience in terms of the 
description.) 

In accordance with this image communication sys- 
tem, the user of the image editingapparatus 1 generates 
an edited image of one frame using a plurality of images 
and information relating to the edited image is transmit- 
ted to the main server 30, whereupon the edited image 
is printed by the printer server 32. The edited image that 
has been printed is delivered to the user of the image 
editing apparatus 1 by mail. The information relating to 
the edited image includes information relating to the po- 
sitions of the images constituting the edited image, im- 
age data representing the edited image, etc. The details 
will become clear in the description that follows. 

Fig. 2 is a block diagram showing the electrical con- 
figuration of the image editing apparatus 1. The image 
editing apparatus 1 usually is located in the user's home. 

The overall operation of the image editing appara- 
tus 1 is supervised by a CPU 2. 

The image editing apparatus 1 includes a ROM 3 t 
a RAM 4 for temporarily storing data, a VRAM 12 for 
temporarily storing data representing an image dis- 
played on a display unit 14 in order that image editing 
may be performed, and a memory controller 15 for con- 
trolling readout of data from the ROM 3 as well as writing 
and reading of data to and from the RAM 4 and VRAM 
12. Image data read out of the VRAM 12 is applied to a 
DA converter 1 3, whereby the image data is converted 
to an analog image signal so that an image is displayed 
on the display unit 14. 

A bus controller 5, the memory controller 15 and a 
timer 1 6 are connected to the image editing apparatus 1 . 

A system I/O controller 6 is connected to the image 



editing apparatus 1. Connected to the system I/O con- 
troller 6 are a keyboard 7 and mouse 8 for accepting 
operation commands from the user of the image editing 
apparatus 1 , a CD-ROM drive 9 for reading image data. 

s an FD (floppy disk) drive 10 and a modem 11 for con- 
necting to the network. 

An external I/O controller 18 is connected to the im- 
age editing apparatus 1. A flatbed scanner 21, a film 
scanner 22, a digital still-video camera 23 and an HD 

io (hard disk) drive 24 are connected to the external I/O 
controller 18. An operating program is stored on a hard 
disk (not shown) to and from which data can be freely 
written and read by the HD drive 24. (The operating pro- 
gram is installed in the image editing apparatus 1 and 

is stored on the hard disk by loading a CD-ROM storing 
the program into the CD-ROM drive 9, described later, 
and reading the CD-ROM.) Prescribed processing, de- 
scribed later, is executed by the image editingapparatus 
1 by reading the operating program stored on the hard 

20 disk. 

A printer 20 for printing images and a printer control 
circuit 19 for controlling the printer 20 are connected to 
the image editing apparatus 1. 

The user uses the image editing apparatus 1 to edit 

25 a desired image. The image editing processing will be 
described later in greater detail. 

Fig. 3 is a block diagram illustrating the electrical 
configuration of the main server 30. Components in Fig. 
3 identical with those shown in Fig.2 are designated by 

30 like reference characters and need not be described 
again. The image server 31 also has a construction 
identical with that of the main server 30. The operating 
program of the main server 30 (image server 31) is in- 
stalled in the main server 30 (image server 31) and 

35 stored on the hard disk by loading a CD-ROM storing 
the program into the CD-ROM drive 9 and reading the 
CD-ROM. 

A high-speed film scanner 25 is connected to the 
external I/O controller 1 8 included in the main server 30. 

40 Further, various files and folders, etc., are stored on a 
hard disk subjected to data read/write by the HD drive 
24 connected to the external I/O controller 18. 

Fig. 4 is a block diagram illustrating the electrical 
configuration of the printer server 32. Components in 

45 Fig. 4 identical with those shown in Fig. 2 are designated 
by like reference characters and need not be described 
again. The operating program of the printer server 32 is 
installed in the printer server 32 and stored on the hard 
disk by loading a CD-ROM storing the program into the 

50 CD-ROM drive 9 and reading the CD-ROM. 

The printer server 32 has a laboratory digital printer 
26 that is connected to the printer control circuit 1 9. The 
laboratory digital printer 26 is a printer capable of high- 
quality printing and prints an image that has been edited 

55 by the user. 



8 



BNSDCCID: <EP 0860986A2_L> 



15 



EP 0 860 986 A2 



16 



(2) Arrangement of various files 



Fig. 5 illustrates the arrangement of various files 
and folders that have been stored on the hard disk con- 
nected to the main server 30. It.goes without saying that 
the hard disk connected to the image server 31 also has 
a similar arrangement of files and folders. 

An editing information management file manages 
an image editing ID issued in regard to editing informa- 
tion transmitted from the image editing apparatus 1. 

The printing information management file manages 
printing information relating to edited image data trans- 
mitted from the main server 30 to the printer server 32. 
The printing information includes an image editing ID, 
an image file name of edited image data that is trans- 
mitted to the printer server 32, and the name of the print- 
er server that is the destination of the transmission. The 
printing information is written in when the edited image 
data is transmitted to the printer server 32 and is deleted 
based upon notification of end of printing from the printer 
server 32. 

A stock image registration table stores the file 
names of image data stored in a stock image folder, de- 
scribed later, of the main server 30. By verifying a file 
name that has been stored in the stock image registra- 
tion table, it is possible to ascertain whether image data 
having the file name is present in the main server 30. In 
a case where there is an image upload from the image 
editing apparatus 1 or another image server 31 , the file 
name of the image data is stored in the stock image reg- 
istration table. 

An order folder manages an edited image manage- 
ment folder that is for generating an edited image. 

The edited image management folder is a folder for 
managing the image editing operation. The edited im- 
age management folder is generated when the image 
editing ID has been issued. After the edited image data 
has been transmitted to the printer server 32, the read- 
ing of data out of the edited image management folder 
is inhibited in order to protect copyright-protected imag- 
es and personal images. The edited image manage- 
ment folder also is deleted based upon notification of 
end of printing fronh the printer server 32. 

The edited image management folder includes an 
editing information file, an upload image management 
file, a transfer request information management file and 
images for editing. 

The editing information file stores editing informa- 
tion, which is transmitted from the image editing appa- 
ratus 1 , in correspondence with an image used in gen- 
erating an edited image. 

The upload image management file stores the file 
name of image data uploaded from the image editing 
apparatus 1. When image data designated by the edit- 
ing information transmitted from the image editing ap- 
paratus 1 has not been stored in any image server, the 
file name of this image data is stored in the file in order 
to allow the user of the image editing apparatus 1 to up- 



load this image data. 

The transfer request information management file 
manages information issuing an image data transfer re- 
quest to the image editing apparatus 1 or another image 
5 server 31 . The transfer request information manage- 
ment file includes a file name of image data for which a 
transfer request has been issued, the quantity of image 
data, an in-transit flag indicating whether the transfer of 
the image data is finished, and a timer name ol a timer 
10 started at the beginning of a transfer request. 

The image file for editing purposes stores a large 
quantity of editing image data used to print an edited 

image. , + . 

The stock image folder holds image data that has 
75 been stored in the image server. The stock image folder 
holds a Iree image folder, a copyright-protected image 
tolder and a personal image folder. 

Free images, namely images that any user can use 
free of charge (see Figs. 6 and 7), are stored in the free 
20 image folder. Printing image data (an image file for print- 
ing purposes) used in printing of an edited image and 
reduced image data (a reduced image file) which the 
user employs to generate an edited image in the image 
editing apparatus 1 are stored, in corresponding form, 
2S in the free image folder. 

Image data representing copyright-protected imag- 
es the use whereof requires billing is stored in the cop- 
yright-protected image folder. 

Data representing personal images only a specific 
30 user is allowed to use by authentication is stored in the 
personal image folder. 

Image data for printing and reduced image data are 
stored in correspondence in both the copyright-protect- 
ed image tolder and personal image folder. 
35 An authentication code for authorizing use of a per- 
sonal image stored in the personal image folder is stored 
in the authentication table. 

By way of example, an edited image shown in Fig. 
10 is generated in the image editing apparatus 1 using 
40 images shown in Figs. 6 through 9. 

Fig. 11 illustrates the file structure of the reduced 
image file. 

The reduced image file includes a header, informa- 
tion (data length, path to reduced image data, etc.) re- 
45 lating to image attributes, an URL ID, image attributes 
(distinction among free images, copyright-protected im- 
ages and personal images), the size of image data for 
printing, and reduced image data. 

Figs. 1 2 and 1 3 illustrate the file structures of image 
so files for printing. 

Fig. 12 shows the file structure of a printing image 
file of free images and personal images, and Fig. 13 
shows the file structure ol a printing image file for cop- 
yright-protected images. 
55 As shown in Fig. 12, the printing image file of free 
images and personal images includes a header, infor- 
mation (data length, path to reduced image data, etc.) 
relating to image attributes, and image data for printing. 
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As shown in Fig. 13, the information relating to im- 
age attributes in the case of a copyright-protected image 
includes, in addition to the data length and path to re- 
duced image data, etc., the name of the transmitting 
server, the name of the printer server of destination of s 
the edited image data, a billing management number, 
an image file name managed by the transmitting server, 
the number of prints ordered, the unit price per print and 
the total price. 

A printing image file and its corresponding reduced 10 
image file are mapped by the URL ID. 

Fig. 14 illustrates the file structure of the edited im- 
age file. 

The edited image file includes attribute information 
relating to image attributes and edited image data. The is 
tag information relating to image attributes includes data 
length, path to edited image data : the name ol the trans- 
mitting server, the name of the printer server of destina- 
tion of the edited image data, a billing management 
number, an image file name managed by the transmil- 20 
ting server, the number of prints ordered, the unit price 
per print, the total price and the name, zip code, ad- 
dress, telephone number, FAX number and e-mail ad- 
dress of the ordering individual. 

25 

(3) Examples of utilization of image communication 
system 

Figs. 1 5 through 1 9 illustrate examples in which the 
image communication system of this embodiment is uti- 30 
lized. Data sent and received in the image communica- 
tion system is temporarily stored in the RAM 4 of each 
unit or server and, when necessary, is stored on a hard 
disk. 

In Fig. 1 5, reduced image data representing images 35 
of reduced size stored in the main server 30 and image 
server 31 is downloaded to the image editing apparatus 
1 . The latter performs image editing using the reduced 
images represented by the reduced image data that has 
been downloaded. 40 

In this case, in order to perform image editing, the 
user of the image editing apparatus 1 requests the main 
server 30 and image server 31 to transfer image data 
representing desired images. Upon receiving the trans- 
fer request from the image editing apparatus 1 , the main 45 
server 30 and image server 31 send the image editing 
apparatus 1 the reduced image data of the image data 
that conforms to the transfer request. 

The image editing apparatus 1 performs an image 
editing operation using the reduced image data trans- so 
mitted from the main server 30 and image server 31. 
When image editing by the user ends, the editing infor- 
mation for generating an edited image is transmitted 
from the image editing apparatus 1 to the main server 
30. At this time the image data is transmitted to the main 55 
server 30. 

Upon receiving the editing information from the im- 
age editing apparatus 1 , the main server 30, based upon 



the editing information received, generates edited im- 
age data representing the edited image. When image 
data necessary for generating the edited image data has 
not been stored in the main server 30 : the latter com- 
municates with another image server 31 and the image 
data is downloaded to the main server 30. 

When the edited image data has been generated, 
this data is transmitted to the printer server 32 and is 
printed out thereby. The edited image that has been 
printed is mailed to the user of the image editing appa- 
ratus 1. 

In Fig. 16, reduced image data representing images 
of reduced size stored in the main server 30 and image 
server 31 is downloaded to the image editing apparatus 
1. The latter performs image editing using the reduced 
images represented by the reduced image data that has 
been downloaded as well as an image for printing rep- 
resented by the printing image data that has been stored 
in the image editing apparatus 1. 

In this case also reduced image data is downloaded 
from the main server 30 and image server 31 to the im- 
age editing apparatus 1 . The image editing apparatus 1 
performs an image editing operation using the reduced 
images represented by the downloaded reduced image 
data and the stored image for printing. If necessary, the 
CPU 2 executes processing for reducing the quantity of 
printing image data to that of the reduced image data. 
When image editing by the user ends, the editing infor- 
mation and the printing image data stored in the image 
editing apparatus 1 used in image editing are transmit- 
ted from the image editing apparatus 1 to the main serv- 
er 30. 

The main server 30 generates edited image data 
from the transmitted editing information and printing im- 
age data. The edited image data that has been gener- 
ated is transmitted to the printer server 32, which pro- 
ceeds to print the edited image. 

In Fig. 1 7, reduced image data that has been stored 
in the main server 30 and image server 31 is download- 
ed to the image editing apparatus 1 . The latter performs 
image editing using the reduced images represented by 
the reduced image data that has been downloaded as 
well as reduced images that have been stored in the im- 
age editing apparatus 1. 

Reduced image data read from a floppy disk is 
stored in the image editing apparatus 1 . 

When the user of the image editing apparatus 1 per- 
forms image editing using the downloaded reduced im- 
ages and the stored reduced images, the editing infor- 
mation is transmitted from the image editing apparatus 
1 to the main server 30. Image data is not transmitted 
from the image editing apparatus 1 to the main server 
30. 

On the basis of the editing information, the main 
server 30 retrieves printing image data used in gener- 
ating an edited image. Edited image data is generated 
from the retrieved printing image data and editing infor- 
mation. The edited image data that has been generated 
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is transmitted to the printer server 32. The latter prints 
the edited image. 

Fig. 1£ shows an example in which edited image 
data is generated in the image editing apparatus 1. 

In this example, printing image data and reduced 
image data read from a floppy disk have been stored in 
the image editing apparatus 1. 

An edited image is generated using printing images 
represented by printing image data of a plurality of 
frames stored in the image editing apparatus 1 . The ed- 
ited image data representing the edited image that has 
been generated is transmitted from the image editing 
apparatus 1 to the printer server 32. 

The printer server 32 prints the edited image using 
the edited image data that has been received. 

Fig. 1 9 shows an example in which an edited image 
is generated using thumbnail images represented by 
thumbnail image data that has been stored in the image 
editing apparatus 1. 

Here the user performs image editing using re- 
duced images represented by reduced image data (read 
from a floppy disk or the like) that has been stored in the 
image editing apparatus 1. Editing information is trans- 
mitted from the image editing apparatus 1 to the main 
server 30. On the basis of the editing information, the 
main server 30 retrieves printing image data that is for 
use in generating the edited image. Edited image data 
is generated from the printing image data that has been 
retrieved and it transmitted to the printer server 32. The 
latter prints the edited image. 

(4) Processing for reading in image in image editing 
apparatus 



Figs. 20 through 25 are flowcharts illustrating the 
procedure of processing for reading in an image. This 
processing is executed in accordance with the operating 
program installed in the image editing apparatus 1 . Figs. 
26 and 27 are diagrams illustrating examples of screens 
displayed on the display unit 14 of the image editing ap- 
paratus 1 in image read-in processing. 

First, it is determined whether an image is to be read 
in from a server (the main server 30 or image server 31 ) 
or from a driver (the CD-ROM drive 9 or FD drive 10) 
(step 41). The user already knows whether the image 
to be read in from the server is a copyright-protected 
image, free image or personal image and decides the 
type of image lo be read from the server (step 42). In a 
case where the image to be read in is a copyright-pro- 
tected image or free image, the application name ol the 
software that controls the operation of the image editing 
apparatus 1 and the version name of this application are 
transmitted to the main server 30 (step 43). 

A response from the main server 30 is awaited. If 
there is no response within a fixed period of time, it is 
judged that there is no response and an error is dis- 
played on the display unit 14 (step 44; "YES" at step 45; 
step 51). 



If a response is received from the main server 30 
within the fixed period of time ("NO" at step 45), then the 
main server 30 determines whether access to a copy- 
right-protected image is permitted (step 46). More spe- 
5 cifically, on the basis of the application name that has 
been transmitted to the main server 30, it is determined 
whether the operating software of the image editing ap- 
paratus 1 is capable of freely storing, in readable fash- 
ion, the image data of a copyright-protected image 
w downloaded from the main server 30. If the image data 
of the copyright-protected image cannot be freely stored 
in readable fashion, use of the copyright-protected im- 
age without permission can be prevented. Accordingly, 
access to the copyright-protected image is permitted 
is ("YES" at step 46). II access is permitted, the URL of 
the copyright-protected image lolder is acquired (step 
47). As a result, an image selection screen, on which 
images represented by the reduced image data that has 
been stored in the copyright-protected image folder hav- 
20 ing the URL are displayed, is displayed on the display 
unit 14 of the image editing apparatus 1 (step 60), as 
shown in Fig. 27. 

If access to a copyright-protected image is refused 
by the main server 30 ("NO" at step 46), then it is deter- 
25 mined whether an image attempting to be accessed by 
the user is a free image (step 48). If the image is a free 
image, the URL of the free image folder is acquired (step 
49). As a result, the image selection screen is displayed 
on the display unit 14 (step 60). If the image which the 
30 user is attempting to access is not a free image, it is 
judged that authorization is not allowed and an error is 
displayed (step 50). 

If an image about to be downloaded from the main 
server 30 is a personal image (step 42), an authentica- 
35 tion code input screen shown in Fig. 26 is displayed on 
the display unit 14 (step 52). 

As shown in Fig. 26, the authentication code input 
screen has areas A1 , A2, A3 and A4. 

The area A1 displays an e-mail address entered by 
40 the user, and the area A2 displays an authentication 
code entered by the user. The area A3 is clicked by the 
user when the entered e-mail address or authentication 
code is correct.. T£e area A4 is clickedrby the user in 
order to cancel the entered e-mail address or authenti- 
45 cation code when the address or code is incorrect. 

With reference again to Fig. 22, the authentication 
code is entered by the user (step 53) and the entered 
aulhenlicalion code is uploaded lo the main server 30 
(step 54). 

so A response from the main server 30 is awaited. If 
there is no response within a fixed period of time, it is 
judged that there is no response and an error is dis- 
played on the display unit 1 4 (step 55; "YES" at step 56; 
step 59). If a response is received from the main server 
55 30, then it is determined whether access to a personal 
image is allowed. 

If the authentication code entered by the user is not 
listed in the authentication table of the main server 30, 
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then authorization is denied and this is displayed on the 
display unit 14 ("NO" at step 57; step 58). 

When the selection screen shown in Fig. 27 is dis- 
played, an image to be downloaded to the image editing 
apparatus 1 is selected by the user (steps 60, 61 ). The s 
image selection screen includes areas A5, A6, A7 and 
A8, as shown in Fig. 27. 

The area A5 displays images represented by the 
image data that has been recorded in the free image 
folder, copyright-protected image folder or personal im- 
age folder. If the user clicks an image displayed in area 
A5 ; this image is selected and the selected image is dis- 
played in area A6. The area A7 is clicked when data 
representing a selected image is to be downloaded. The 
area A8 is clicked to cancel the data. 

When an image is selected, data representing the 
iiic n^me of the image data representing this image is 
transmitted to the main server 30 and the image data 
tn-tt hris been stored in the main server 30 is download- 
ed ic im-j imrige editing apparatus 1 at step 62 in Fig. 
23 Piuccbbing for retrieving the image data in the main 
server 30 will be described in detail later. 

r there is no response from the main server 30 with- 
in n lixcd period of time, it is judged that there is no re- 
sponse :jnd an error is displayed on the display unit 14 
(*YES" Hi stop 63 step 71). If a read-in error occurs, a 
dispUy to this effect is presented on the display unit 14 
and tne image data undergoing downloading is deleted. 
As a result, processing for reading in the image data 
ends temporarily ("YES" at step 64; steps 68, 69, 70). If 
necessary, the main server 30 would be accessed 
again 

If downloading of image data ends without a read- 
in error, then the image data is registered in the image 
list ("YES" at step 65; steps 66, 67). This image list is 
used in image editing in the image editing apparatus in 
a manner described later. 

In a case where image data is to be read in from a 
driver the format of image data representing the image 
to be read in is checked at step 72 in Fig. 24, this image 
data being among the image data recorded on the me- 
dium loaded in the driver. If the format is not one that 
makes it possible to read in this image data ("NO" at 
step 73), a display to this effect is presented on the dis- 
play unit 14 (step 75). If the format is one that makes it 
possible to read in this image data ("YES" at step 73), 
then it is determined whether this image data is reduced 
image data (step 74). 

If the data is not reduced image data ("NO" at step 
74), this image data is judged to be high-quality image 
data for printing purposes, which data is of large quan- 
tity. This data is read (step 80). If a read-in error occurs 
while reading in of the image data is in progress, a dis- 
play to this effect is presented ("YES" at steps 81 , 82; 
step 33). 

The image data that has been read in is registered 
in the image list in order to generate an edited image 
(steps 84, 85). 



If the image data that has been stored on the me- 
dium is reduced image data ("YES" at step 74), it is de- 
termined whether this reduced image data has an as- 
signed URL ID (step 77). If there is no URL ID, then the 
reduced image data is read in as is (step 80). If an URL 
ID has been assigned (step 77), a verification message 
indicating whether or not printing image data corre- 
sponding to the reduced image data read from the me- 
dium has been stored is transmitted to the server des- 
ignated by this URL ID (step 78). If a response is not 
received from the server in a fixed period of time, an 
error display is presented (step 97). 

If there is no printing image data that corresponds 
to the reduced image data ("NO" at step 87), it is judged 
that the reduced image data is not supported and the 
reduced image is displayed (step 96). If image data for 
printing is present, then this printing image data is trans- 
mitted from the server and is registered in the image list 
of the image editing apparatus 1 (steps 88 - 92). If a 
read-in error occurs when printing image data is being 
downloaded from the server, an error display is present- 
ed and printing image data that was in the process of 
being downloaded is deleted (steps 93 - 95). 

An image list for generating an edited image is gen- 
crated in the RAM 4 of the image editing apparatus 1 
based upon the image read-in processing described 
above. 

Fig. 28 through 36 are flowcharts illustrating the pro- 
cedure of image editing processing and image output 
processing executed by the image editing apparatus 1 . 
This processing also is executed in accordance with the 
operating program installed in the image editing appa- 
ratus 1 . Figs. 37 and 38 are diagrams illustrating exam- 
ples of screens displayed on the display unit 14. Fig. 39 
is diagram illustrating examples of editing information 
transmitted from the image editing apparatus 1 to the 
main server 30. 

A screen illustrated in Fig. 37 is displayed on the 
display unit 1 4 of the image editing apparatus 1 in image 
editing and output processing. This screen includes ar- 
eas A10, A11, A12, A13and A14. 

The area A10 is an editing area in which an edited, 
image (see Fig. 10) is displayed. Ihe area All is a control 
panel in which partitions for applying instructions tor 
generating an edited image appear. The area A12 is an 
image list display area in which images (e.g. images 
shown in Fig. 6 through 9) that have been registered in 
the image list are displayed. The area A1 3 is an area for 
outputting results of editing. Editing information for gen- 
erating an edited image is output by clicking on this area. 
Clicking the area A1 4 ends the image editing and output 
processing. 

In image editing and output processing, checking of 
the image list is carried out first (step 103). If the image 
list is checked and is found to exist, the image data that 
has been registered in the image list is read in and the 
images are displayed in the image list display area at 
steps 140 - 143 in Fig. 33. 
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Next, when an image is to be edited, the editing area 
is clicked by the user (steps 101 . 110). This establishes 
an image editing mode. 

When image editing is performed, an image being 
displayed in the image list display area A12 is dragged 
to a desired position in the editing area by the user (step 
111). It necessary, the user employs the control panel 
area A11 to command, say, adjustment of the sizes of 
the images constituting the edited image. If adjusting of 
the position, size, etc., of the edited image is finished, 
the image selection operation is canceled ("YES" at 
steps 112, 113, 114). If adjustment has not ended, then 
the painting of the editing area is updated in accordance 
with a command from the control panel (step 116). 

When image editing ends, clicking the area for out- 
putting the results of editing causes a transition to 
processing for outputting these results (step 102). 

Processing for outputting results ot editing includes 
a case in which output is delivered to a server and a 
case in which output is delivered to a medium, such as 
a disk, or to a printer. 

In case of output to a server (step 106), editing in- 
formation is subjected to a format conversion in such a 
manner that the information can be transmitted from the 
image editing apparatus 1 to the main server 30 (step 
117). As shown in Fig. 39, the editing information in- 
cludes order information, type of printing, file name, URL 
ID, image attribute, file size, plotting order and plotting 
signal. The editing information is generated by reading 
information (see Fig. 1 1 ) accompanying data represent- 
ing an image selected in the image editing mode. When 
the format conversion ends, an order input screen of the 
kind shown in Fig. 38 is displayed on the display unit 1 4. 

As shown in Fig. 38, the order input screen includes 
areas A21, A22, A23 and A24. The user enters order 
information while observing the data input screen. The 
order information includes personal information and 
number of prints ordered. The personal information con- 
sists of the name (and the transcription thereof in kana), 
zip code, address, telephone number, FAX number and 
e-mail address of the orderer (user), namely the individ- 
ual ordering printing of the edited image. When this per- 
sonal information is entered, it is displayed^ area A21 . 
When the number of ordered prints is entered, the 
number is displayed in area A22. If the entered personal 
information and number of ordered prints are correct, 
area A23 is clicked. If the entered personal information 
or number of ordered prints is incorrect, the area A24 is 
clicked. 

When order information is thus entered by the user 
at step 1 1 9 in Fig. 30, the user applies a print command 
to the image editing apparatus 1 (step 120). The print 
information that has undergone the format conversion 
is transmitted from the image editing apparatus 1 to the 
main server 30 in response to the print command. It 
goes without saying that the order information entered 
by the user also undergoes a format conversion. 

If there is no upload image data from the user, then 



the program returns to the processing of step 105. 106 
or 107 

If there is upload image data from the user ("YES" 
at step 122), an upload request from the main server 30 
5 is awaited for a fixed period of time (step 123). If there 
is no upload request from the main server 30 within the 
fixed period of time, then it is construed that there is no 
answer from the server and an error display is presented 
("YES" at step 1 24; step 1 30). 
10 If image data having the file name of an image in- 
cluded in the editing information transmitted Irom the im- 
age editing apparatus 1 has not been stored in the main 
server 30 or in another image server 31 , then it is judged 
that the user will upload image data that has been stored 
is in his or her own image editing apparatus 1. cause the 
main server 30 to generate an edited image using this 
image data and cause the printer server 32 to print the 
edited image. Accordingly, an upload request is output 
from the main server 30 to the image editing apparatus 
20 i . If the upload request is received from the main server 
30 within the fixed period of time ("NO" at step 1 24), then 
the upload destination folder and a list (upload list) of 
image data to be uploaded are transmitted from the 
main server 30 to the image editing apparatus 1 (step 
25 1 25). 

The image editing apparatus 1 compares the up- 
load list transmitted from the main server 30 and the file 
name of the image data to be transmitted to the main 
server 30 (step 126). If the result of the comparison is 
30 agreement ("NO" at step 127). then the image data 
specified by the upload list is transmitted from the image 
editing apparatus 1 to the main server 30 (step 128). In 
case of non-agreement ("YES" at step 127), a collation 
error is displayed on the display unit 1 4 (step 1 29). If the 
35 collation error occurs, then the image data would be up- 
loaded again as necessary. 

In a case where image data representing an edited 
image is saved on a disk or the edited image is printed 
using the printer of the image editing apparatus (step 
40 107), first an area for the purpose of outputting the im- 
age data is acquired in the RAM 4 of the image editing 
apparatus 1 (step 131). Next, it is determined, based 
upon the image attributes accompanying the reduced 
image data, whether even one copyright-protected im- 
45 age is included among the images constituting the ed- 
ited image (step 132; see Fig. 11). 

If a copyright-protected image is not included ("NO" 
at step 1 33), the edited image is stored in ihe area of 
RAM 4 (step 134). If a copyright-protected image is not 
so included in the edited image, the user can save or print 
the edited data freely. 

If all image data representing the images constitut- 
ing the edited image are to be stored in the RAM 4 in 
order to output the image, then it is determined, based 
55 upon a command from the user, whether the edited im- 
age is to be printed using the printer 20 or saved on a 
disk. If neither is specified, a print selection error is dis- 
played on the display unit 1 4 (step 1 38). 
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In a case where the edited image is printed using 
the printer 20 ("YES" at step 1 36) : the temporarily stored 
edited image data is read out of the RAM 4 and output 
to the printer 20 (step 1 46). If all of the edited image data 
has been output from the RAM 4 to the printer 20 nor- 
mally, a display to this effect is presented on the display 
unit 1 4 (steps 1 47 - 1 49). If an error occurs in the output 
of the edited image from the RAM 4 to the printer 20, 
then print error is displayed on the display unit 14 (step 
150). In such case printing would be executed again as 
necessary. 

(n a case where the edited image data is saved to 
disk ("YES" at step 137), the format of the edited image 
data is converted by the CPU 2 in order that it can be 
saved to the disk (step 151). If necessary, the edited im- 
age data is subjected to compression processing along 
with the format conversion processing. 

If saving of the edited image data to the disk ends 
normally, then a display to this effect is presented on the 
display unill 4 (steps 1 53, 1 54). If an error occurs in the 
saving of the image data to the disk, then a write error 
message is displayed on the display unit 14 (step 155). 

When all processing for image editing and image 
output ends, the end area A14 is clicked by the user. In 
response to the clicking operation, all of the image data 
and editing information stored temporarily in the RAM 4 
is erased (steps 144, 145). Since copyright -protected 
image data is erased by this operation, the user can be 
prevented from using the copyright-protected image 
freely. 

(5) Authentication processing in main server 

Figs. 40 and 41 are flowcharts illustrating the pro- 
cedure of authentication processing executed in the 
main server 30. This processing is executed in accord- 
ance with the operating program that has been installed 
in the main server 30. 

This authentication processing includes personal- 
image authentication carried out when personal image 
data is downloaded from the main server 30, and stock- 
image authentication carried out when copyright-pro- 
tected image data or free IViage data is downloaded 
from the main server 30. 

Execution of the authentication processing proce- 
dure is started by receiving editing information from the 
image editing apparatus 1 and detecting a request for 
access to a free image folder, copyright-protected image 
folder or personal image folder (step 161). An authenti- 
cation request from the image editing apparatus 1 is 
awaited for a fixed period of time. If the fixed period of 
time elapses, data representing denial of access is 
transmitted to the image editing apparatus 1 (step 162, 
"YES" at steps 163, step 170). 

If there is an authentication request within the fixed 
period of time, then it is determined whether the authen- 
tication is personal-image authentication (step 164). In 
case of personal-image authentication, receipt of an au- 



thentication code from the user of the image editing ap- 
paratus 1 is awaited (step 165). If the authentication 
code is received from the user within the fixed period of 
time, then the authentication code transmitted from the 

5 user and the authentication codes that have been stored 
in the main server 30 are compared (steps 166, 167). If 
the compared codes agree ("YES" at step 1 68), the URL 
of the personal image folder is transmitted to the user 
of the image editing apparatus 1 (step 169). Since the 

io user thus obtains the URL of the personal image folder 
the user can access this folder and can download the 
personal image data that has been stored in the person- 
al image folder. 

In a case where an authentication code is not trans- 

7 5 mitted from the user within the fixed period of time or the 
comparison with the authentication code stored in the 
authentication table results in non-agreement, then data 
representing access denial is communicated to the user 
(step 170). 

20 |n case of authentication of a stock image ("YES" 

at step 171), then it is determined whether image data 
for which downloading has been requested by the user 
is copyright-protected image (step 172). If a copyright- 
protected image has not been requested ("NO" at step 

25 1 72), then the request is judged to be one for download- 
ing free image data. Since free image data is allowed to 
be used freely by all users, data representing access 
permission and the URL of the free image data are 
transmitted to the user 

30 |f the image data for which downloading has been 
requested is copyright-protected image data, it is deter- 
mined, on the basis of the application name and version 
transmitted from the user and the application name that 
has been stored in an application authentication table, 

35 whether the application software of the image editing 
apparatus 1 is capable of storing, in freely readable 
fashion, the copyright-protected image data download- 
ed as set forth above (step 173). 

If, on the basis of the application authentication ta- 

to ble, it is determined that the image editing apparatus 1 
is being operated by application software which allows 
downloading of copyright-protected image data ("YES" 
at step 174), data indicating access permission and the 
URL name of the copyright-protected image folder are 

4 5 transmitted to the user. As a result, the user is capable 
of downloading copyright-protected image data. If the 
application software of the image editing apparatus 1 
does not allow downloading of copyright-prolected im- 
age data, then data representing access denial is trans- 

50 mitted from the main server 30 to the image editing ap- 
paratus 1 (step 176). 

(6) Processing for receiving editing information and 
processing for editing images 

55 

Figs. 42 through 45 are flowcharts illustrating the 
procedure of processing for receiving editing informa- 
tion transmitted from the image editing apparatus 1 and 
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processing for editing images based upon the editing 
information. This processing is executed in accordance 
with the operating programthat has been installed in the 
main server 30. 

The processing is started by receiving the editing 
information from the image editing apparatus 1 (steps 
181, 182). 

When the editing information is received from the 
image editing apparatus 1, a management ID is issued 
in conformity with the editing information and the ID is 
registered in the editing information management file 
(step 163). Next, the edited image folder specified by 
the issued management ID is generated in order to gen- 
erate the edited image data (step 184). 

Next, it is determined whether the URL of an image 
constituting the received edited image is included in the 
received editing information. 

If the URL of the image is included in the received 
editing information ("YES" at step 186), it is judged 
whether the image data representing this image has 
been stored in the main server 30 or image server 31 , 
and a stock image registration table is verified (step 
187). If the URL of an image recorded in the received 
editing information has been stored in the stock image 
registration table ("YES 0 at step 1 88), then the particular 
folder in which the URL of this image and the image data 
have been stored in stored in the image information stor- 
age file (step 206). If the URL of the image has not been 
stored in the editing information, then the image data 
constituting the edited image cannot be retrieved by the 
main server 30. This means that the edited image of the 
user cannot be generated unless the image data repre- 
senting this image is transmitted from the image editing 
apparatus 1 . Accordingly, the file name of this image is 
stored in the upload image management file (step 189) 
and in the transfer request information management file 
(step 190). 

In a case where the URL of an image constituting 
the edited image is located in the editing information but 
is not located in the stock image registration table of the 
main server 30, it is conceivable that the image data rep- 
resenting this image has been stored in another image 
server 31 . The main server 30, therefore, directs an in- 
quiry to the other image server 31 to inquire as to wheth- 
er image data having the URL of this image has been 
stored there (step 191). 

On the basis of the stock image registration table 
possessed by the other image server 31, this other im- 
age server 31 determines whether the image data in- 
quired about has been stored. 

On the basis of reply data from the other image 
server 31 , the main server 30 verifies whether the image 
data has been stored in the other image server 31 (steps 
1 92, 1 93, 1 94). If the image data has not been stored in 
the other image server 31, an edited image cannot be 
generated based upon the editing information transmit- 
ted from the user. An error display, therefore, is present- 
ed on the display unit 14 of the main server 30 (step 



202). Data indicating that the edited image cannot be 
generated and that processing terminated abnormally 
is transmitted to the user (step 203). Since the edited 
image cannot be generated, the edited image manage- 
5 ment folder is deleted (steps 204, 205). 

In a case where image data not present in the main 
server 30 is that of an image constituting an edited im- 
age and has been stored in the other image server 31 
("YES" at step 194), the image attribute of the image 
10 stored in the editing information is verified (step 1 95). In 
a case where the image attribute is indicative of a free 
image ("YES" at step 196), the image data of the image 
that has been stored in the other image server 31 is 
transmitted to the main server 30 and is stored in the 
15 free image folder (step 197). The storage of the image 
information is accompanied by storage of the tile name 
of the image data in the stock image registration table 
(step 198). In a case where the image attribute is not 
indicative of a free image (meaning that the image is a 
20 copyright-protected image or personal image) ("NO" at 
step 1 96), management will be too complicated if the 
same image data is stored in a plurality of image servers 
31 . Accordingly, the image data is stored in the edited 
image management folder that will be deleted subse- 
ts qucntly (step 201 ). 

When storage of the image data in the free image 
folder or edited image management folder begins, a tim- 
er starts keeping time (step 199) and the file name of 
the image data is stored in the transfer request informa- 
30 tion management file (step 200). Furthermore, the par- 
ticular lolder in which the image data has been stored 
is stored in the editing information storage file (step 
206). 

At the end of verification, in regard to all images con- 
35 stituting the edited image that has been stored in the 
editing information, as to whether the image data repre- 
senting these images is located in the main server 30 
or in the other image server 31 or is to be downloaded 
from the image editing apparatus 1 (step 207) : the file 
40 name of image data to be uploaded by the user based 
upon the data that has been stored in the upload image 
management file is transmitted to the image editing ap- 
paratus 1 (step 208). In adefition, an upload timer starts 
keeping time (step 209). 
45 Next, data representing the editing information 
transmitted from the image editing apparatus 1 is stored 
in the editing information management file (step 210). 

Reference is had to the transfer request information 
management file and the image data received by the 
50 main server 30 is verified as well as the image size 
(steps 211 , 212). If the image data received by the main 
server 30 is not indicative of the verified image size, first 
it is determined whether reception of image data is in 
progress ('NO" at step 21 3; steps 21 6, 217). If reception 
55 of image data does not end upon elapse of a fixed period 
of time ("YES" at step 21 7), processing ends via an error 
step (step 218). If it is judged, based upon the image 
size thereof, that reception of the image data has been 
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completed, then an in-transit flag in the transfer request 
information management file is cleared (step 214). 

If it is determined by referring to the transfer request 
information management file that all image data to be 
received has been received by the main server 30, then 
timekeeping by all timers of the main server 30 is 
stopped ("YES" at step 215; step 220). 

The transfer request information management table 
is relerred to again to check for in-transit flags (step 
221). 

If there is even one in-transit flag, an error determi- 
nation is made and this is transmitted to the image ed- 
iting apparatus 1 . Further, since generation of the edited 
image desired by the user is not possible, the editing 
information management folder is deleted (steps 229 - 
232). II there is not a single in-transit flag in the transfer 
request information management file, it is construed that 
all image data to be transferred from the image editing 
apparatus 1 or other image server 31 has been re- 
ceived. As a result, generation of the edited image be- 
comes possible. 

In order to generate the edited image, reference is 
had to the edited image management file and edited im- 
age data is generated based upon editing information 
that has been stored in the edited image management 
file and data representing where the image data repre- 
senting the edited image data has been stored (steps 
224, 225). if the edited image data has been generated, 
it is stored temporarily in the RAM 4. 

In order to prevent edited image data from being 
generated again, the reading in of data managed by the 
edited information management file is inhibited (step 
226). The edited image data that has been generated is 
applied to the display unit 14. The operator of the main 
server 30 observes the edited image to verify the same 
(step 227). If the edited image is being displayed, then 
the printer server 32 best suited to the printing of the 
edited image is selected based upon the type of printing 
included in the editing information (step 233). 

In order to print the edited image, the edited image 
data is generated again (step 234) and is transmitted to 
the printer server 32 that has been selected (step 235). 
The edited image data is registered in a transmission 
management tile (step 236). 

(7) Server-to-server communication processing 

Fig. 46 is a flowchart illustrating processing for com- 
munication between the main server 30 and image serv- 
er 31. 

In a case where image data representing an image 
constituting an edited image is not present in the main 
server 30, the main server 30 sends an inquiry to the 
image server 31 in the manner described above. The 
processing of Fig. 46 is started by this inquiry. When the 
other image server 31 receives a confirmation request 
from the main server 30 (steps 240, 241 ), the file name 
of image data for which confirmation of the presence 



thereof has been requested is received by the image 
server 31 (step 242). The image server 31 confirms 
whether the received file name of the image data has 
been stored in the stock image registration table (step 

s 243). If the file name has been stored in the stock image 
registration table, a message to this effect is transmitted 
to the main server 30 that issued the confirmation re- 
quest and the image data having this file name is trans- 
mitted to the main server 30 as well (steps 245, 246). If 

to the file name has not been stored in the stock image 
registration table, then a message to this effect is trans- 
mitted to the main server 30 that issued the confirmation 
request (steps 245, 244). 

75 (8) Printing processing by printer server 

Figs. 47 and 48 are flowcharts illustrating the pro- 
cedure of processing for printing an edited image in the 
printer server 32. This processing is executed in accord- 

20 ance with the operating program that has been installed 
in the printer server 32. 

This processing starts in response to receipt of ed- 
ited image data transmitted from the main server 30. A 
print image file (not shown) is generated in response to 

2S receipt of the edited image data. 

When the edited image data is transmitted from the 
main server 30 (steps 261, 262), the printer server 32 
verifies the transmitting server name and transmission 
destination server name included in tag information re- 

30 lating to image attributes and accompanying the edited 
image data. If both are verified, then the edited image 
represented by the edited image data and an order form 
are printed by the digital printer 26 for the processing 
laboratory (step 269). The order form is printed based 

35 upon storage of the image tag information accompany- 
ing the edited image data. 

When the edited image is printed, the operator of 
the printer server 32 checks to see whether the edited 
image has been printed normally (step 270). If printing 

40 has been performed correctly, the printed matter is 
packaged by the operator of the printer server 32 and is 
sent to the user of the image editing apparatus 1 by C. 
O.D. (steps 272 - 274). lT,s a result, the print image file 
storing the edited image data is deleted (step 275). 

45 if the server name of the transmitting server cannot 
be verified in print processing, an error message is dis- 
played and the print image file is deleted (steps 265, 
266). In a case where it is judged that the transmitting 
server name or printed edited image is abnormal, an er- 

50 ror display is presented and data representing abnormal 
termination is transmitted along with the edited image 
data (steps 276, 277). 

(9) Processing for ending printing by server 

55 

Fig. 49 is a flowchart illustrating a processing pro- 
cedure executed by the server 30 or 31 in a case where 
the printing of an edited image has been completed in 
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the printer server 32. This processing also is executed 
in accordance with the operating program that has been 
installed in the server 30 or 31 . 

The processing starts in response to receipt of data 
representing notification ol end of printing of the edited 
image from the printer server 32. 

When data representing end of printing is received 
from the printer server 32 (steps 250, 251), it is deter- 
mined whether an error has occurred in printing (step 
252). If an error has not occurred, data representing the 
fact that printing was performed normally is transmitted 
to the image editing apparatus 1 (step 253). As a result, 
the user of the image editing apparatus 1 can be notified 
of the fact that the edited image will be mailed at a later 
date. If an error has occurred, data representing the fact 
is transmitted to the image editing apparatus 1 (step 
254). Asa result, the user of the image editing apparatus 
1 would edit the image again as necessary and transmit 
the edited image information to the main server 30. 

Next, the edited image management folder is delet- 
ed and information relating to the edited image is delet- 
ed from the transmission management file (step 256). 

(10) Processing for verifying status of edited image 
generation 

In a case where the image editing apparatus 1 has 
ordered the main server 30 to print an edited image in 
the manner described above, the user of the image ed- 
iting apparatus 1 can be notified of the edited status of 
the edited image in the main server 30 and the printing 
status of the edited image in the printer server 32. 

If, in a case where the user of the image editing ap- 
paratus 1 has been notified of editing status and printing 
status of the edited image, editing information is trans- 
mitted from the image editing apparatus 1 to the main 
server 30, data representing acceptance of the editing 
information and a characteristic verification I D are trans- 
mitted from the main server 30, which has received the 
editing information, to the image editing apparatus 1 that 
has transmitted the editing information. 

When the editing status and printing status are to 
be verified, the user of the ir/iag? editing apparatus 1 
sends the transmitted verification ID to the main server 
30. Upon receiving the verification ID transmitted from 
the image editing apparatus 1 , the main server 30 sends 
the image editing apparatus 1 status data indicating the 
editing status and printing status. Upon receiving the 
status data, the image editing apparatus 1 displays the 
editing status and printing status of the edited image on 
the display unit 14 based upon the status data. By ob- 
serving the display on the display unit 14 of the image 
editing apparatus 1 , the user of the image editing appa- 
ratus 1 can be notified of the editing status and printing 
status of the edited image. 

Figs. 50 through 52 illustrate examples of the edit- 
ing status and printing status of the edited image in the 
main server 30, these screens being displayed on the 



display unit 14 of the image editing apparatus 1. If the 
status cannot be displayed on one screen, the screen 
is scrolled. 

Fig. 50 shows an example of a screen displayed on 
5 the display unit 14 of the image editing apparatus 1 
based upon status data transmitted from the main serv- 
er 30 to the image editing apparatus 1 in a case where 
the verification ID has been transmitted from the image 
editing apparatus 1 to the main server 30 in order that 
10 the user of the image editing apparatus 1 may inquire 
about the status of printing alter an order to print an ed- 
ited image has been received. It is possible for this 
screen to be displayed by accessing the top page of a 
website on the Internet. 
is Icons 11 representing status in a straightforward 
manner are displayed on the screen in such a manner 
that status can be understood at a glance. The icons 11 
indicate a plurality of conditions depending upon the 
particular state. The icon corresponding to the current 
20 status is clearly displayed in such a manner that it can 
be distinguished from other icons. This arrangement 
makes it possible for the user of the image editing ap- 
paratus 1 to immediately comprehend the currently pre- 
vailing status. The content of an order placed by the user 
25 also is displayed on the screen (in a display area 12). 
Since the content of an order is displayed, the user can 
immediately confirm the same. Since it is assumed here 
that the user will goto pick up an edited image that has 
been printed, the name of the store at which the image 
30 should be picked up also is displayed. The age and gen- 
der of the user are displayed as well. By clicking an area 
13, the user restores the basic screen. 

Fig. 51 shows an example of a screen displayed on 
the display unit 14 of the image editing apparatus 1 
35 when the verification ID is transmitted from the user of 
the image editing apparatus 1 to the main server 30 in 
a case where an edited image has been generated by 
the main server 30. 

In this case an icon among the icons 11 that indi- 
40 cates verification of a finished product is clearly dis- 
played so as to distinguish it from the other icons. The 
edited image is displayed in area 14. By observing the 
edited image, the user is capable of determining wheth- 
er the desired edited image has been obtained. If the 
45 user verifies that the desired edited image has been ob- 
tained, the user clicks an area 16. As a result, printing of 
the edited image is executed. When the edited image 
desired by the user has not been obtained, an area 15 
is clicked by the user, whereby the order is canceled. 
so Fig. 52 shows an example of a screen displayed on 

the display unit 14 of the image editing apparatus 1 
when the verification ID is transmitted from the user of 
the image editing apparatus 1 to the main server 30 in 
a case where printing of the edited image has been com- 
55 pieted and the printed edited image has been dis- 
patched to a store specified by the user. 

An icon among the icons 11 that indicates that the 
edited image is to be picked up at a store is clearly dis- 
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played so as to distinguish it from the other icons. Infor- 
mation indicating the store at which the edited image is 
to be picked up is displayed in an area 17. The user of 
the image editing apparatus 1 can receive the printed 
edited image by going to the store indicated. 

(11 ) Processing for billing of copyright-protected 

images 

(a) Overview 

Billing processing for a case where a copyright-pro- 
tected image is being utilized as an edited image will 
now be described. 

Fig. 53 illustrates the overall flow of processing in 
the image communication system in a case where billing 
processing is carried out. Figs. 54 A - C illustrate exam- 
ples of files generated in the main server 30 and image 
server 31, and Fig. 55 shows an example of a file gen- 
erated in the printer server 32. 

If billing processing is executed, three billing files 
are generated in the main server 30 and image server 
31 in the manner illustrated in Figs. 54 A - C. The first 
billing file shown in Fig. 54a is referred to in a case where 
edited image data is generated using copyright-protect- 
ed image data that has been stored in the server's own 
copyright-protected image folder. The second billing file 
shown in Fig. 54b is referred to in order to perform man- 
agement in a case where edited image data is generat- 
ed using copyright-protected image data that has been 
stored in the copyright -protected image folder of another 
server. The third billing file shown in Fig. 54c is referred 
to in order to perform management when copyright-pro- 
tected image was used as edited image data transmitted 
to the printer server 32. 

The first billing file includes the transmission desti- 
nation server name, image file name, unit fee billed per 
copyright-protected image, number of prints, total billed 
price, billing management number, receipt number, a re- 
ceipt completed flag and a cancel flag. 

The second billing file includes the transmitting 
server name, customer ^formation and a payment- 
made flag instead of the transmission destination server 
name, receipt number and receipt completed flag ol the 
first billing file. The third billing tile has the same struc- 
ture as that of the first billing file. 

As shown in Fig. 55, customer informalion and a 
payment-made flag are stored in the billing file of the 
printer server 32 instead of the receipt number and re- 
ceipt completed flag of the first billing file. 

If the edited image data that has been generated by 
the editing information transmitted from the image edit- 
ing apparatus 1 does not use copyright-protected image 
data, the following processing is executed if it is not im- 
possible. 

Upon receiving the editing information transmitted 
from the image editing apparatus 1 , the main server 30 



determines whether a request for a copyright-protected 
image is included in this editing information. If there is 
a request for a copyright-protected image, it is deter- 
mined, based upon the URL whether the image data 
5 representing the copyright-protected image has been 
stored in the main server's own copyright-protected im- 
age folder or in the copyright-protected image folder of 
the other image server 31 . II the image data has been 
stored in the server's own copyright-protected image 
io folder, then the billing management number is issued 
and the transmitting server name, image file name, 
billed unit price, number of prints, total billed price, billing 
management number and customer information are 
stored in the second billing file. If the image data has 
is been stored in the copyright-protected image folder of 
the other image server 31 , then the billing management 
number and receipt number are transmitted to the other 
image server 31. Upon receiving the billing manage- 
ment number and receipt number, the other image serv- 
er 31 stores the transmission destination server name, 
image file name, billed unit fee per copyright-protected 
image, number of prints and total billed fee in the first 
billing file. 

When copyright-protected image data is transmit- 
ted Irom the other image server 31 to the main server 
30 in a case where copyright-protected image data re- 
quested by the image editing apparatus 1 has been 
stored in the copyright-protected image folder of the oth- 
er image server 31 , the transmission destination server 
name, image file name, billed unit fee, total billed fee 
and billing management number are stored as the tag 
information accompanying this copyright-protected im- 
age data. The main server 30 checks this tag informa- 
tion to determine whether the image data has arrived at 
its own location. 

Upon receiving the image data transmitted from the 
other image server 31, the main server 30 checks the 
tag information that has been stored in the received im- 
age data and reads the information relating to billing. 
The information relating to billing that has been read is 
stored in the second billing file. 

When the edited image data is generated in the 
manner described above, the main server 30 stores the 
information relating to billing for the copyright-protected 
image used in generation of the edited image data in the 
third billing file. It goes without saying that if the copy- 
right-protected image that has been stored in the main 
server 30 is used, then information relating to billing re- 
garding this copyright-protected image data also is 
stored. 

The information relating to billing is stored in the tag 
information accompanying the edited image data gen- 
erated in the main server 30 and is transmitted to the 
main server 30. 

Upon receiving the edited image data, the main 
server 30 reads the information relating to billing from 
the tag information accompanying the edited image data 
and stores the information relating to billing in the third 



25 



30 



35 



40 



45 



50 



55 



BNSDOCID: <EP 0860986A2_I_> 



35 



EP 0 860 986 A2 



36 



billing file. 

(b) Details of billing processing 

The details of billing in a case where an image is 
edited and the edited image is printed will now be de- 
scribed. 

Figs. 56a and 56b illustrate examples of component 
images which constitute an edited image stored in the 
main server 30, and Fig 57 shows an example ol a tem- 
plate image serving as the background of the compo- 
nent images. Here the component images and template 
image are copyright-protected images for which pay- 
ment is billed. To facilitate understanding, however, 
these images will be referred to as component images 
and as a template image, respectively. Fig. 58 shows an 
example of a component image that has been stored in 
the image editing apparatus 1, and Fig. 59 shows an 
edited image. A case in which the image shown in Figs. 
59 - 58 is utilized to print the edited image shown in Fig. 
59 will be described. 

The component images and the template image are 
generated by a user capable of accessing the main serv- 
er 30. The generated component images and template 
image are registered (stored) in the main server 30. A 
registration fee is required if component images and a 
template image are registered in the main server 30. 
Further, in a case where an image has been registered, 
a fee for designing the image is paid to the individual 
that created the images. The user of the registered im- 
age is required to pay a fee for use as well. 

(i) Processing for billing for registration of component 
images 



A user is billed in a case where a created compo- 
nent image is registered in the main server 30 in the 
manner described above. Fig. 60 is a flowchart illustrat- 
ing the procedure of billing processing in a case where 
a component image is registered in the main server 30. 

Component images for printing of the kind shown in 
Fig. 56 A or B are created by the user. The image editing 
apparatus 1 of the user who has created a component 
image and the main server 30 are connected and a re- 
quest for transmission of the component image is sent 
to the main server 30. The image data representing the 
generated component image is transmitted from the im- 
age editing apparatus 1 to the main server 30 (step 261 ). 
The component image data is transmitted by a compo- 
nent image registration file shown in Fig. 61 . The com- 
ponent image registration file includes a header, which 
indicates that the file is the component image registra- 
tion file, the ID of the component image copyright holder, 
an ID list of IDs of individuals capable of using the com- 
ponent image free of charge, a design fee required at 
the time of editing desired by the creator of the compo- 
nent image, a design fee required at the time of printing, 
an editing use fee, a printing use fee and high-quality 



component image data used for printing. 

When component image data that has been trans- 
mitted from the image editing apparatus 1 is received 
by the main server 30, the component image, which is 
s represented by the component image data, is displayed 
on the display unit of the main server 30. The operator 
of the main server 30 observes the component image 
displayed on the display unit of the main server 30 to 
make sure that the component image data has not been 
10 destroyed (step 271). 

If the component image has been destroyed ("NO" 
at step 272), the main server 30 sends the image editing 
apparatus 1 data indicating suspension registration of 
the component image (step 273). Upon receiving the da- 
75 ta indicating suspension of registration ("YES" at step 
262), the image editing apparatus 1 displays a message 
to this effect on the display unit 14 of the image editing 
apparatus 1 and executes prescribed processing, e.g., 
re-registration. 

20 If the component image has not been destroyed 

("YES* at step 272). then reference is had to the design 
fee and use fee included in the component image reg- 
istration file and the design fee and use fee for this com- 
ponent image are decided. The decided design fee and 
2S use fee and the component image registration fee are 
transmitted from the main server 30 to the image editing 
apparatus 1 (step 274). There is also a care where the 
decided design fee and use fee is a fee set by the user, 
and there are instances where these fees are revised. 
30 If the user of the image editing apparatus 1 does 
not acknowledge the design fee and use fee transmitted 
from the main server 30 ("NO" at step 263), data indi- 
cating suspension of registration of the component im- 
age is transmitted Irom the image editing apparatus 1 
35 to the main server 30 (step 264). In response to receipt 
of the registration suspension data transmitted Irom the 
image editing apparatus 1, the main server 30 termi- 
nates image editing processing ("YES" at step 275). 
If the user of the image editing apparatus 1 agrees 
40 to the design fee and use fee transmitted from the main 
server 30 ("YES" at step 263), data indicating agree- 
ment is transmitted from the image editing apparatus 1 
to the main server 30 (step^J»5). whereupon the main 
server 30 issues a component ID specific to this com- 
45 ponent image data (step 276). 

Next, editing component image data used in editing 
thumbnail image data for selecting editing and compo- 
nenl image data is generated from the component im- 
age data for printing transmitted from the image editing 
so apparatus 1 (step 277). When the editing component im- 
age data and thumbnail image data is generated, a print- 
ing component image file illustrated in Fig. 62 A is gen- 
erated based upon the component image data transmit- 
ted Irom the image editing apparatus 1 . Further, an ed- 
55 iting component image file shown in Fig. 62 B is gener- 
ated based upon the editing component image data, and 
a thumbnail image file shown in Fig. 62 C is generated 
based upon the thumbnail image data. Each of these 
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files includes a header, a component image ID, a copy- 
right holder ID and image data. 

The printing component image file, editing compo- 
nent image file and thumbnail component image file thus 
generated are stored in a hard disk (database) connect- s 
ed to the main server 30 (step 278; see Fig. 77). 

When registration of the image files in the data base 
of the main server 30 is completed, notification of com- 
pletion of registration is transmitted from the main server 
30 to the image editing apparatus 1 and the user who 10 
generated the component image data is billed for the 
component image registration fee (step 279). 

In response to being billed for the component image 
registration fee by the main server 30 : the user of the 
image editing apparatus 1 pays the registration fee (step is 
266). 

(ii) Processing for generating template image 

Fig. 63 is a flowchart illustrating the procedure of 20 
processing for generating a template image. 

A template image can be generated using compo- 
nent images. In a case where a component image is 
used to generate a template image, the image editing 
apparatus 1 which generates the template image and 2s 
the main server 30 communicate with each other. 

First, a request for transmission of thumbnail-com- 
ponent images is sent from the image editing apparatus 
1 to the main server 30 (step 281). 

Upon receiving the thumbnail-component image 30 
transmission request, the main server 30 searches its 
database and transmits the thumbnail-component im- 
ages to the image editing apparatus 1 (step 291). 

Upon receiving the thumbnail-component image 
data transmitted from the main server 30, the image ed- 35 
iting apparatus 1 displays the thumbnail-component im- 
ages, which are represented by the thumbnail-compo- 
nent image data, as a list on the display unit 14 of the 
image editing apparatus 1 . The user of the image editing 
apparatus 1 selects a component image, used in gen- 40 
eration of the template image, from the list of thumbnail- 
component images displayed on the display unit 14 
(step 282). 

Whether the user of the image editing apparatus 1 
possesses a selected component image is judged 
based upon the component ID that corresponds to this 
component image (step 283). 

If the user of the image ediling apparatus 1 pos- 
sesses the selected component image ("YES" at step 
283), the image data representing the component image so 
is read in to the image editing apparatus 1 (step 284). If 
the user of the image editing apparatus 1 does not pos- 
sess the selected component image ("NO" at step 283), 
a request for transmission of editing component image 
data corresponding to this component image is trans- ss 
mitted from the image editing apparatus 1 to the main 
server 30 (step 285). The processing of steps 282 
through 285 is repeated for all component images used 



in the template image (step 286). 

Upon receiving the request for transmission of a 
component image from the image editing apparatus 1 , 
the main server 30 determines, in accordance with a list 
of IDs of individuals permitted free use of component 
images, whether the user of the component image is al- 
lowed to use it free of charge (step 292). 

If the user of the component image is an individual 
permitted to use the component image free of charge 
("YES" at step 292), editing component image data cor- 
responding to this component image is transmitted from 
the main server 30 to the image editing apparatus 1 
(step 293). 

If the user of the component image is not permitted 
to use it free of charge ("NO" at step 292), the compo- 
nent image editing use fee and editing design fee are 
read out of the database (step 294). The individual who 
generated this component image is paid the design fee 
in accordance with the design fee that has been read 
out (step 295). 

The number of times the user who requested trans- 
mission of the component image employed this compo- 
nent image is checked (step 296). The component im- 
age editing use fee and the component image printing 
use fee decline in dependence upon the number of 
times the component image is used. In this embodiment, 
the greater the number of times a component image is 
used, the higher the discount on the component image 
editing use fee, as illustrated by the editing fee discount 
table shown in Fig. 74. 

If this is the first time for a user to use the component 
image ("YES" at step 297), then user data is registered 
anew (step 298). If this is not the first time for a user to 
use the component image, then the discount is retrieved 
from the number of times the user used the component 
image and from the editing fee discount table shown in 
Fig. 74 (step 299). 

In either case, the use fee for the user employing 
the component image is calculated (step 300) and the 
number of times the user used the component image is 
incremented (step 301). 

The data of the editing component image that cor- 
responds to the component image requested by the us- 
er is transmitted from the main server 30 to the image 
editing apparatus 1 (step 293). 

When the data of the editing component images is 
obtained, layout of the template image is performed. 
When the template image is generated, a layout fee re- 
garding the template image is set (step 287). 

If the template image is generated, processing for 
registering the template image is executed next. 

(iii) Processing for billing for registration of template 
images 

Figs. 64 and 65 are flowcharts illustrating process- 
ing for registering a template image. 

When a template image is registered in the main 
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server 30, a design fee and use fee (referred to as "spe- 
cial fees") are set also in regard to the component im- 
ages constituting the template image. This differs from 
the case in which a component image is registered in 
the main server 30. Special tees are set by the user and 
ultimately are decided in communication with the main 
server 30. 

When a template image is registered in the mam 
server 30, a template image registration file shown in 
Fig. 66 is transmitted from the image editing apparatus 
1 to the main server 30 (step 311 ). Unlike the component 
image file, the template file includes, in regard to the 
component images constituting the template image., an 
editing design fee (a special design fee at time of editing) 
in regard to the component images constituting the tem- 
plate image, a printing design fee (a special design lee 
at time of printing), an editing use lee (a special use fee 
at the time of editing) and a printing use tee (a special 
use fee at the time of printing), these fees corresponding 
to the component images constituting the template im- 
age. 

When the template image file is transmitted to the 
main server 30, the content of the file is checked (step 
321 ). If the result of checking shows that the image data 
has been destroyed, this fact is transmitted to the image 
editing apparatus 1 ("NO* at step 322; step 323). The 
image editing apparatus 1 executes predetermined 
processing in dependence upon suspension of registra- 
tion (step 312). If the result of checking shows that the 
image data has not been destroyed ("YES* at step 322), 
then a component image constituting the template im- 
age is retrieved (step 324). 

It is determined whether the creator ol the template 
image is an individual permitted to use the retrieved 
component image free of charge (step 325). 

If the individual is one not permitted to use the com- 
ponent image free of charge ("NO" at step 325), then 
the special fee included in the template image file is 
transmitted to the user who created the component im- 
age (step 326). When the user who created the compo- 
nent image does not agree to the special fee transmitted 
from the main server 30 ("NO" at step 327), a new spe- 
cial fee is set by the user wha Seated the component 
image (step 328). When the user who created compo- 
nent image agrees to the special fee ("YES" at step 
327), the processing of step 328 is skipped. The 
processing of steps 324 ~ 239 is repeated in regard to 
all component images constituting the template image. 

The editing design fee, printing design fee, editing 
use fee and printing use fee of the template image are 
decided by referring to the special fee that has been de- 
cided and the editing design fee, printing design lee, ed- 
iting use fee and printing use fee decided by the user 
who generated the template image (step 330). When the 
fees that have been decided are transmitted to the im- 
age editing apparatus 1 which generated the template 
image and the user who generated the template image 
agrees to the fees, a template image ID is issued ("YES" 



at step 313; steps 315, 332). If the user does not agree 
to the fee, then registration of the template image is sus- 
pended ("NO" at step 313; steps 314, 331). 

A printing template image file, editing template im- 
5 age file and thumbnail template image file shown in Figs. 
67a, 67b and 67c, respectively, are generated and reg- 
istered in the database of the main server 30 (steps 333, 
334). A header, template ID, copyright holder ID and 
number of component images used are stored in the 
io printing template image file, editing template image file 
and thumbnail template image file. A component image 
10 a nd layout information are stored in the printing tem- 
plate file in correspondence with the number of compo- 
nent images used. A template image is reproduced 
is based upon the component ID and layout information. 
Thumbnail image data is stored in the thumbnail tem- 
plate image file. The thumbnail template image is repro- 
duced by reading out the thumbnail image data. 



20 (rv) Processing for billing (or image editing 

Fig. 68 is a flowchart illustrating the procedure of 
billing processing when image editing is performed. 
Image editing involves executing image editing 
25 processing at one's own image editing apparatus 1 us- 
ing component images that have been registered with 
the main server 30. Accordingly, billing processing when 
image editing is performed is substantially the same as 
the billing processing procedure executed at the time of 
30 template creation shown in Fig. 63. Processing steps in 
Fig. 68 identical with those shown in Fig. 63 are desig- 
nated by like step numbers and need not be described 
again. 

When all component images constituting a template 
35 image are read in the image editing apparatus 1 in ac- 
cordance with the template billing processing shown in 
Fig 63. layout of the template image is performed and 
the layout fee is set (step 287). With the image editing 
billing processing shown in Fig. 68, however image ed- 
40 King processing is carried out by combining a template 
image or component images transmitted from the main 
server 30 with a user image that has already been stored 
in one's own image editing apparatus 1 (step 288). 

45 (v) Processing for billing for printing of edited image 

Figs. 69 through 72 are flowcharts illustrating a 
processing procedure lor billing in a case where an ed- 
iting image is printed. 
so First, the printing fee is initialized (step 340). Next, 
it is determined whether an edited image is to be printed 
utilizing a template image already registered in the main 
server 30 (step 341). 

When the edited image is to be printed using a tem- 
55 plate image already registered in the main server 30 
fYES" at step 341), the fee in a case where printing is 
performed using the template image is calculated (steps 
342 through 351). 
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First, it is determined whether the individual who or- 
dered printing of the edited image is one permitted to 
use the template image free of charge (step 342). II the 
individual is one permitted to use the edited image free 
of charge ("YES" at step 342), then no fee is charged 
for use of the template image. If the individual is not one 
permitted to use the edited image free of charge ("NO" 
at step 342), then the fee to use the template image and 
the design fee are calculated in dependence upon the 
number of prints ordered (step 343). The calculated de- 
sign fee is paid by the operator of the main server 30 to 
the creator of the template image (step 345). 

The number of times the user attempting to print the 
edited image has used this template image is retrieved 
from the database and checked (step 346). 

In a case where this is the first time to use the tem- 
plate image, the data relating to the individual who or- 
dered the printing of the edited image is registered anew 
in a manner similar to that performed when an image is 
edited (step 350). 

If the template image data has already been utilized 
("NO" at step 347), then the number of times it has been 
used is read out of the database. The fee for printing 
processing declines as the number of times the same 
template image is used increases in a manner to similar 
to that of image editing : as illustrated in Fig. 73. Refer- 
ence is had to a printing fee discount table shown in Fig. 
73 and the discount is retrieved based upon the number 
of times the template image was used (step 348). The 
use fee per print of the template image is decided using 
the retrieved discount (step 349). The use fee that has 
been decided is multiplied by the number of prints and 
the use fee of the template image is decided in a case 
where printing is performed utilizing this template image 
(step 351 ). The number of times the template image was 
used is incremented. 

When the fee for using the template image is calcu- 
lated, the next step is to calculate the fee for using the 
component images constituting the template image 
(steps 352 through 363 in Fig. 70). 

First, a component image constituting the template 
image is retrieved by the main server 30 (step 352). The 
fee is calculated for each jfetrieved component image in 
the same manner that the fee for the template image 
was calculated above. That is, it is determined whether 
the orderer is an individual permitted to use the compo- 
nent image free of charge. If the orderer is not such an 
individual, then the design fee for the component image 
is paid to the user who created this component image 
(steps 354, 355). 

The number of times this component image has 
been used is retrieved and the component image use 
fee for each frame is decided in dependence upon the 
frequency or use. The decided component image use 
fee for each frame is multiplied by the number of prints 
and the fee for use of the component image constituting 
the template image is decided (steps 361 - 363) 

When a template image registered in the main serv- 



er 30 is not used, the fee regarding the component im- 
age used in printing is calculated (steps 364 - 375 in 
Fig. 71). 

The calculation of the fee regarding the component 
5 image is performed in the same manner as the above- 
described calculation of the fee for the template image 
and the calculation for the fee of a component image 
constituting the template image. 

First, the component image is retrieved by the main 
to server 30 (step 364). It is determined, for each retrieved 
component image, whether the orderer of printing is an 
individual allowed to make free use of the component 
image. If the orderer is not such an individual, then the 
design fee is paid to the creator of this component image 
75 (steps 366 : 367). The number of times the component 
image has been used is checked and the use fee for 
one frame of the component image is calculated in de- 
pendence upon the number of times (steps 369 - 373). 
The calculated fee for one frame is multiplied by the 
20 number of prints and the fee for the component image 
in case of printing is calculated (step 374). 

When the use fee for printing of the template image 
and component image constituting the template image 
or the use fee for printing the component image is cal- 
25 culatcd, the cost of the paper is calculated. 

Fig. 75 illustrates a paper cost discount table. The 
paper cost is decided for each type of paper and the 
paper cost corresponding to the type of paper specified 
by the ordered is read out (step 376). 
30 The fee for the type of service, such as how printing 
is to be performed, is decided. 

Fig. 76 illustrates a table of costs for various serv- 
ices. The cost is decided for each type of printing service 
and the corresponding cost is read out of the table (step 
377). 

The fee for use of the image, the paper cost and the 
cost of the printing service thus calculated are added 
together to calculate the final printing fee (step 379). The 
orderer of printing is invoiced for the final printing fee. 

(12) Processing for receipt of payment 

Processing for receipt of payment will be described 
next. 

When a printed article, namely an edited image 
printed by the printer server 32, is received by CO D. 
post, as shown in Fig. 78, the payment is sent to the 
operator of the printer server 32. The payment includes 
the printing fee, the fee for using the image communi- 
cation system and the fee billed for a copyright-protect- 
ed image. Processing is the same even in a case where 
the printed article is accepted at a store instead of by C. 
O.D. post. 

The operator of the printer server 32 collects the 
printing fee and sends the remainder of the payment to 
the operator of the main server 30. At this time the pay- 
ment-made flag in the billing management file of the 
printer server 32 is checked. 
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Upon receiving the payment, the operator of the 
main server 30 collects the lee for using the main server 
30 and the fee for using the copyright-protected image 
and sends the remainder of the payment to the other 
image server 31 . At this time the payment-made flag of 
the second billing management file of main server 30 is 
checked. Further, the receipt information (the encrypted 
receipt number, image file name, unit billed fee, total 
billed fee, date and billed customer name) is transmitted 
to the printer server 32. The receipt number is encrypted 
in order to prevent forgery. 

Upon receiving payment, the operator of the image 
server 31 collects the fee for using the copyright image. 
In addition, the receipt completed flag in the first image 
billing file of the image server 31 is checked. Receipt 
information which includes the encrypted receipt 
number, image file name, billed unit fee, total billed fee 
rind date is transmitted from the image server 31 to the 
printer server 32. As a result, the operator of the printer 
s»tTvci 32 is capable of confirming the fact thai the op- 
ciniuis ot nil soivers have received the fees. The printer 
server 22 mny notify other servers of the fact that pay- 
ment hns been received. 

(13) ProccGGing when printing is canceled 

Processing by the printer server 32 in a case where 
printing of an edited image is canceled will now be de- 
scribed 

In a case where a malfunction occurs at the printer 
server 32 and an edited image cannot be printed as a 
consequence, a cancellation flag in the billing manage- 
ment file of the printer server 32 is checked (see Fig. 
79). In addition, the main server 30 is notified of cancel- 
lation. Upon receiving notification of cancellation, the 
main server 30 checks the cancellation flag of the sec- 
ond billing management file of the main server 30. The 
image server 31 is notified of cancellation as well. Upon 
receiving notification of cancellation, the image server 

31 checks the cancellation flag of the first image billing 
file. 

Upon receiving notification of cancellation, the main 
server 30 and image server 31 send the printer server 

32 cancellation notification mail which includes the en- 
crypted receipt number, image file name, date and billed 
customer name. Further, the main server 30 sends the 
image editing apparatus 1 cancellation mail which in- 
cludes the receipt number, billed customer name, image 
file name, cancellation name and date. As a result, the 
user of the image editing apparatus 1 is capable of giv- 
ing notification of the fact that printing of the edited im- 
age has been canceled, as well as the reason for can- 
cellation. 

(14) Authentication processing 

In the embodiment described above, the image ed- 
iting apparatus 1, main server 30 and image server 31 



execute processing for sending and receiving image da- 
ta to and from each other without executing authentica- 
tion processing. However, data can be sent and re- 
ceived upon utilizing an authentication station to verify, 

s by an electronic signature, whether an individual is au- 
thorized to send and receive data. 

Fig. 80 illustrates a procedure in a case where data 
is sent and received between the image editing appara- 
tus 1 and the main server 30 utilizing an authentication 

10 station. 

An authentication station 35 is provided in addition 
to the image editing apparatus 1 and main server 30. 
The image server 31 and printer server 32 are not shown 
in Fig. 80. 

is In order to request authentication, the user of the 
image editing apparatus 1 and the operator of the main 
server 30 each transmit the public key of the requester 
and the requester name to the authentication station 35. 
In this case a public key K01 and name (ID) of the image 

20 editing apparatus 1 are transmitted from the image ed- 
iting apparatus 1 to the authentication station 35, and a 
public key K02 and name (ID) of the main server 30 are 
transmitted from the main server 30 to the authentica- 
tion station 35. 

25 If the authentication station 35 confirms that the im- 

age editing apparatus 1 and main server 30 are legiti- 
mate, then the authentication station 35 generates an 
authentication form obtained by encrypting the received 
public key K01 and name of the image editing apparatus 
30 i by a private key KS0 of the authentication station. Sim- 
ilarly, the authentication station 35 generates an authen- 
tication form obtained by encrypting a received public 
key K02 and name of the main server 30 by the private 
key KS0 of the authentication station. 
35 A public key K00 of the authentication station is en- 
crypted by the public key K01 of the image editing ap- 
paratus 1 , arid the encrypted public key K00 of the au- 
thentication station and authentication form are trans- 
mitted to the image editing apparatus 1. The encrypted 
40 public key K00 of the authentication station encrypted 
can be decrypted in the image editing apparatus 1 using 
a private key KS1 of the image editing apparatus 1 The 
public key K00 of the authentk^t ion station is encrypted 
by the public key K02 of the* main server 30, and the 
45 encrypted public key K00 of the authentication station 
and authentication form are transmitted to the main 
server 30. The encrypted public key K00 of the authen- 
tication station can be decrypted in the main server 30 
using a private key KS2 of the main server 30. 
so When the authentication form is received by the im- 
age editing apparatus 1 , the latter encrypts order infor- 
mation by the private key KS1 of the image editing ap- 
paratus 1 and transmits the encrypted order information 
and the authentication form of the image editing appa- 
55 ratus 1 to the main server 30. 

Upon receiving the data transmitted from the image 
editing apparatus 1 , the main server 30 decrypts the au- 
thentication form of the image editing apparatus 1 by the 
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public key K00 of the authentication station. As a result, 
the main server 30 obtains the public key K01 of the im- 
age editing apparatus 1 and the information relating to 
the image editing apparatus 1. Further, the main server 
30 decrypts the editing information, which has been s 
transmitted from the image editing apparatus 1 and en- 
crypted, by the decrypted public key K01 of the image 
editing apparatus 1 to obtain the editing information and 
information relating to the image editing apparatus 1 . It 
is determined whether the two items of information re- io 
lating to the image editing apparatus 1 thus obtained 
agree. If the two items of information agree, this means 
that the image editing apparatus 1 is legitimate, it is 
judged that the order is legitimate and the edited image 
is printed. This makes it possible to prevent illegitimate *5 
ordering of printed images. 

An arrangement may be adopted in which legitimate 
invoicing of payment is judged in similar fashion in a 
case where information relating to billing has been au- 
thenticated. 20 

(15) Example of application of image printing system 

An example has been described in which the image 
editing apparatus 1 and printer server 32 are installed 
at different locations However, the image editing appa- 
ratus 1 and printer server 32 may be placed at the same 
location (in the user's home). Further, the image editing 
apparatus 1 and printer server 32 may be constituted by 
a single apparatus. 

A case in which an edited image to be printed is 
generated by the image editing apparatus 1 will be de- 
scribed first. 

Fig. 81 illustrates the manner in which data commu- 
nication is carried out among the image editing appara- 
tus 1 , main server 30, image server 31 and printer server 
32. 

An edited image is generated from a plurality of im- 
ages and edited image data representing the edited im- 
age is transmitted from the main server 30 to the printer 
server 32, which is at the same location as that of the 
image editing apparatus 1 . The printer server 32 prints 
the edited image from the edited image data. 

When the edited image is printed by the printer serv- 
er 32, the editing information of- the printed edited image 
and the data representing the number of prints are trans- 
mitted from the printer server 32 to the main server 30. 

When the editing information of the printed edited 
image and the number of prints are received, a file of 
copyright-protected images used is generated by the 
main server 30 from the received data, as shown in Fig. 
82. 

A header indicative of the file of copyright -protected 
images used, the file name of. the copyright-protected 
images, the server name (URL) managing the copy- 
right-protected images, the server name (URL) manag- 
ing the editing information and the numberof times print- 
ing is performed are stored in the file of copyright-pro- 



tected images used. 

On the basis of the editing information transmitted 
from the printer server 32, it is determined whether the 
printed edited image includes a copyright-protected im- 
age being managed by a server (here assumed to be 
the image server 31) other than the main server 30. 
When a copyright-protected image being managed by 
the image server 31 is included in the printed edited im- 
age, the file of copyright-protected images used is trans- 
mitted to the image server 31 . 

On the basis of the file of copyright-protected imag- 
es used transmitted from the main server 30, the image 
server 31 charges the main server 30 for the fee for use 
of the copyright-protected image. 

The fee for using a copyright-protected image man- 
aged by the image server 31 and the fee for using a cop- 
yright-protected image managed by the main server 30 
are transmitted from the main server 30 to the printer 
server 32. 

Upon being charged lor use of a copyright-protect- 
ed image, the user of the printer server 32 (who is also 
the user of the image editing apparatus 1) pays the op- 
erator of the main server 30 the fee for using the copy- 
right-protected image. 

The fee for using the copy right -protected image is 
calculated in the following manner: 

Fig. 83 shows a list file of copyright-protected im- 
ages used. This file is managed by the main server 30 
and is generated for every copyright-protected image. 
A header indicative of the file of copyright-protected im- 
ages used, the file name of the copyright-protected im- 
ages, the server name (URL) managing the file of cop- 
yright-protected images and the fee for use are stored 
in the file list of copyright-protected images used. 

If it is the copyright-protected image managed by 
the main server 30,the use fee is recorded in the copy- 
right-protected image file, since the use fee is recog- 
nized by the main server 30. 

If an image is a copyright-protected image man- 
aged by the image server 31, the file of copyright-pro- 
tected images used is transmitted from the main server 
30 to the image server 31, where the fee for use is cal- 
culated. The calculated fee for use is transmitted from 
the image server 31 to the main server 30. 

When data representing the fee for using a copy- 
right-protected image is received from the image server 
31, the fee represented by this data is written in a use 
fee section of the file of copyright-protected images 
used. 

When all fees for using copyright-protected images 
are obtained, the total sum is calculated by the main 
server 30 and data representing the total sum calculated 
is transmitted from the main server 30 to the printer serv- 
er 32. 

Next, an explanation is given to a case where the 
main server 30 generates the edited image, and an ed- 
iting image for printing, of which the number of printing 
is restricted became of that the use fee is received from 
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the user of the printer server 32, is transmitted to the 
printer server 32 from main server 30. 

As shown in Fig. 84, the image editing apparatus 1 
requests the main server 30 to generate an edited image 
for printing purposes. The main server 30 responds to 
the request by generating the edited image for printing. 
The main server 30 calculates the fee lor using a copy- 
right-protected image from the editing information trans- 
mitted from the image editing apparatus 1 and the 
number of prints. 

When the fee for using the copy right -protected im- 
age is calculated : the main server 30 charges the user 
of the image editing apparatus 1 for the calculated use 
fee. If the user of the image editing apparatus 1 pays in 
response to being charged, an edited image file for print- 
ing shown in Fig. 85 is transmitted from the main server 
30 to the printer server 32. 

The edited image file for printing includes a header 
indicative of the edited image file for printing, the fee for 
using a copyright-protected image, the number of prints 
capable of being printed and edited image data for print- 
ing. 

The printer server 32 receives the edited image file 
for printing, the latter reads in the edited image data for 
printing contained in the edited image file for printing 
and, whenever printing is performed, decrements the 
number of prints, which are capable of being printed, 
included in the edited image file for printing. Printing of 
edited images represented by the edited image data for 
printing is inhibited when the number of prints capable 
of being printed reaches zero. The number of times 
printing is performed by the printer server 32 can be lim- 
ited even though it is installed at the same location as 
that of the image editing apparatus 1 

In the above application example, the edited image 
is printed in the printer server 32. The main server 30 
may transmit the edited image data generated therein 
to the image editing appears 1 , which may display and 
print the edited image represented by the edited image 
data transmitted.from the main server 30. In this case, 
the edited image data is registered in the main server 
30, and the registered edited image data is transmitted 
to the image editing apparatus f. The image editing ap- 
paratus 1 displays and prints the edited image repre- 
sented by the edited image data transmitted from the 
main server 30. It goes without saying that the edited 
image is only displayed but is not printed, or the edited 
image is only printed but is not displayed. The above 
processing or operation is referred to as "obtaining" of 
the edited image in the image editing apparatus by the 
user. 

An user who registered the edited image in the main 
server 30 can obtain not only the edited image regis- 
tered by himself or herself, but also edited images which 
have been registered by other users. In a case where 
obtaining is permitted, deletion of the edited image data 
in the main server 30 is suspended. In a case where 
obtaining is permitted, image editing processing using 



the copyright-protected image is prohibited. 

Fig. 86 shows processing for printing the edited im- 
age represented by the edited image data in the image 
editing apparatus 1 . Figs. 87 and 88 show examples of 
5 screens appearing on the display unit 14 of the image 
editing apparatus 1 when the processing shown in Fig. 
86 is performed, and Figs. 89 thorough 93 are flow 
charts illustrating the details of the processing shown in 
Fig. 86. 

to The image editing software installed in the image 
editing apparatus V is started by the user (step 381). 
When the image editing software starts, a selection win- 
dow W1 for carrying out selection of registration or ob- 
taining shown in Figs. 87 and 88 appears on the display 

is screen of the display unit 1 4. The selection window W1 
includes an area which is clicked by the user when the 
edited image is registered in the main server 30 and an 
area which is clicked by the user when the edited image 
is obtained. In response to that one ol the areas is 

20 clicked by the user, processing for registration of the ed- 
ited image or processing for obtaining of edited image 
is carried out in accordance with the clicked area (step 
381). 

First, the registration processing will be described. 
25 Here, the edited images arc registered for each catego- 
ry. When the edited image is registered, an unique ID is 
assigned to the edited image data by the main server 
30 such that the same ID with that of other edited image 
data is not assigned. The assigned unique ID is record- 
30 ed in a tag area of the edited image file. 

With reference to mainly Figs. 87 and 89, in the 
processing for registration of the edited image, a cate- 
gory selection window W2 which shows categories clas- 
sifying the edited image is displayed on the display 
35 screen of the display unit 14 of the image editing appa- 
ratus 1 (step 401). It is assumed that "INFORMATION", 
"BULLTIN BOARD", "SELF-INTRODUCTION" and 
"TOPICS" are predetermined as categories. The user 
watches the displayed categories and judges, to which 
40 category the edited image should belong. The category, 
in which the edited image is to be registered, is selected 
by clicking area of the category desired by the user (step 
402). Here, it is assumed that "BULLTIN BOARD" is se- 
lected as the desired category. 
45 A transmission request for a list of template image 
data registered in the selected category is generated in 
response to the selection of the category by the user, 
and the transmission request is transmitted to the main 
server 30 from the image editing apparatus 1 (step 403). 
so When the main server 30 receives the transmission 
request for the list of template image data from the im- 
age editing apparatus 1 (step 410), a list of reduced- 
image-file names of the templates which have been reg- 
istered in the category selected by user of the image 
55 editing apparatus 1 is generated (step 411). The re- 
duced images of the templates, the names of which ap- 
pear in the generated list of the file names., are retrieved, 
and data for displaying the multi-screen of the retrieved 
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template images is generated (step 412). 

The generated data for displaying the list of the tem- 
plate images is transmitted to the image editing appa- 
ratus 1 from the main server 30. The template list is dis- 
played on the display screen of the display unit 1 4 of the 
image editing apparatus 1 based on the received data 
for displaying the list of the template images (step 404, 
an window W3) 

The template list window W3 shows various editing 
template images corresponding to the category select- 
ed by the user. The user selects a template image from 
among the editing template images shown in the tem- 
plate list window W3 by clicking the desired template 
image (step 405). 

When the template image desired by the user is se- 
lected, data requesting the selected template image da- 
trt is transmitted to the main server 30 from the image 
editing apparatus 1 (step 406). When the main server 
30 reserves the template image requesting data from the 
■rrngo oJitmg apparatus 1, editing template image data 
oi the ic^uubted template is searched in response to the 
roceot The found template image data is transmitted 
to the trrvicc editing apparatus 1 from the main server 
30 (step 4i3) The editing template image data trans- 
mitted from the main server 30 is received in the image 
oditmg apparatus 1 (step 406). 

When the editing template image data is received, 
the processing for editing image is carried out using the 
editing template image represented by the editing tem- 
plate image data, the free image orthe like, as described 
above (step 407). In the processing for editing image, 
the editing window W4 is displayed on the display 
screen of the display unit 14. In the processing for edit- 
ing image, the editing information is also inputted. Here, 
the message put up to the bulletin board is also inputted 
in addition to the editing information (step 403). The in- 
dividual information input window W5 is displayed on the 
display screen of the display unit 14 for the input of the 
message. 

When processing for editing image is completed, 
the user image, the editing information and the message 
necessary for generating the edited image data are 
transmitted to the main server 30 from the image editing 
apparatus 1 (step 409). At this time, a window W6 show- 
ing that data transmission is in process is displayed. 

The received image, the editing information, individ- 
ual information or the like are registered in the main 
server 30 (step 41 4). Further, the edited image data rep- 
resenting the edited image generated by the user of the 
image editing apparatus 1 is generated from the free im- 
age, the editing information and the message. The gen- 
erated edited image data is converted to PostScript. 
Further, the generated edited image data is also con- 
verted to HTML (Hyper Text Markup Language). Fur- 
thermore, the generated edited image data is converted 
to PDF (Portable Document Format). The generated ed- 
ited image data, in this way, is converted to three differ- 
ent image formats and they are registered. Further, a 



reduced image of the edited image is generated (step 
415). The window W7 showing completion of registra- 
tion is displayed on the display unit 1 4 of the image ed- 
iting apparatus 1. 

5 The processing results of the processing for gener- 

ating of the edited image data, processing for converting 
to various image formats and processing for generating 
the reduced image are transmitted to the image editing 
apparatus 1 Irom the main server 30. The user of the 

to image editing apparatus 1 which has received the 
processing results may performs again the processing 
for editing image so as to complete the incomplete 
processing, if necessary, upon checking the processing 
results. 

75 As described above the processing for registration 
of the edited image is completed. Next, the processing 
for obtaining will be explained (step 382). 

With reference to mainly Fig. 88 and Figs. 91 
through 93, when the obtaining area of the selection win- 

20 dow wi is clicked by the user, an window W1 2 for se- 
lecting an image format from among image formats 
which are allowed to be obtained is displayed on the dis- 
play screen of the display unit 14 (Fig. 91, step 421). 
The image format selection window W1 2 includes areas 

25 for designating obtaining image formals. Included in the 
window W12 are an area for obtaining image using a 
browser dedicated to the display of the edited image, an 
area for obtaining image using HTML format, an area 
for obtaining image using PDF format and an area for 

30 obtaining image using PostScript format. The obtaining 
image format is selected by clicking the area desired by 
the user from among the displayed above areas (Fig. 
91, step 422). 

Next, an obtaining category selection window W13 

35 is displayed on the display screen of the display unit 14 
(Fig. 91 , step 423). The edited images which can be ob- 
tained are classified under categories, the desired cat- 
egory is selected by the user (Fig. 92, step 424). The 
obtaining category selection window WI 3 shows areas 

40 which indicate categories allowed to be obtained. An ar- 
ea representing a desired category is clicked by the us- 
er. 

When the desired category is selected by the user, 
processing thereafter will proceed to in accordance with 
**5 the selected image format. If the obtaining image is that 
the format of which is the page description language (i. 
e., PostScript and PDF) (Fig. 92, "YES" at step 423), a 
list of file names of edited images which are registered 
in the category selected by the user is generated in the 
50 main server 30 (Fig. 93, step 441 ). The data represent- 
ing the file names appearing in the generated list is 
transmitted to the image editing apparatus 1 from the 
main server 30. The file names of the selected category 
are displayed on a file name list window W16 of the dis- 
ss ptay unit 14 of the image editing apparatus 14 (Fig. 92, 
step 432). 

The edited image to be obtained is selected by click- 
ing a desired file name shown in the file name list win- 
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dow W16 (Fig. 92, step 433). The data representing the 
selected file name, as well as a transmitting request, are 
transmitted to the main server 30 from the image editing 
apparatus 1 . When the data representing the file name 
and the transmitting request are received by the main 
server 30, the edited image data (the edited image data 
for printing) having the file name is searched. The found 
edited image data is transmitted to the image editing ap- 
paratus 1 from the main server 30 (Fig. 93, step 444). 

The edited image data transmitted from the main 
server 30 is recorded on the harddisk of the image ed- 
iting apparatus 1 by the HD drive 24 (Fig. 92, step 434). 
An image viewer software corresponding to the selected 
obtaining image format is started, and the edited image 
represented by the edited image data recorded on the 
harddisk is displayed on the display screen of the dis- 
play unit 14 (Fig. 92, step 434, window W17). For ex- 
ample, if page description language is PostScript, a 
PostScript viewer is started, if the image format is 
HTML, an web brower is started. Further, the edited im- 
age represented by the edited image data recorded on 
the harddisk is printed by the printer 20 connected to the 
image editing apparatus 1 : if required. 

Next, it is assumed that an obtaining image format 
selected by the user of the image editing apparatus 1 is 
the image format other than the page description lan- 
guage (i.e. , HTML, or one which has not been converted 
to any of the above formats) (Fig 92, "NO" at step 425). 
In a case where the selected image format is that other 
than page description language, the list of the file names 
of the reduced images of the edited images registered 
in the selected category is generated by the main server 
30 (Fig. 93, step 443). The multi-screen of the reduced 
images is generated from the image data representing 
the reduced images, the image data representing the 
multi-screen is transmitted to the image editing appara- 
tus 1 from the main server 30. 

When the image data representing the multi-screen 
is transmitted to the image editing apparatus 1 , a multi- 
screen window W14 is displayed on the display unit 14 
of the image editing apparatus 1 (Fig. 92, step 424). 

When a desired reduced image displayed on the 
window W14 is clicked by the user of the image editing 
apparatus 1 , the data representing the tile name of the 
selected edited image is transmitted to the main server 
30 from the image editing apparatus 1 (Fig. 92, step 
428). 

When the data representing the file name of the se- 
lected edited image is received by the main server 30, 
the edited image data designated by the received data 
is searched in the main server 30. If the edited image 
data representing edited image selected by the user of 
the image editing apparatus 1 is found, the edited image 
data is transmitted to the image editing apparatus 1 from 
the main server 30 (Fig. 93 : step 442). 

The image editing apparatus 1 receives the edited 
image data transmitted from the main server 30. It is 
judged whether the format of the received image data 



is HTMK or the other (which means that the image data 
is edited by the image editing software in the main server 
30 but is not converted to any of above the three formats 
(Fig. 92, step 429). If the image format is based on the 
s image lormat of the image editing software, the edited 
image is displayed from the edited image data received 
based on the editing image software dedicated to the 
image editing apparatus (Fig. 92, step 430). Further, the 
edited image is printed, if necessary. II the format of the 
jo edited image data is the HTML format, the edited image 
is displayed by the HTML format (Fig. 92, step 431). As 
a result, the edited image is displayed on the screen of 
the display unit 14 (window W15). 

The edited image is registered not only inone image 
is format, but also in a plurality of types of image formats 
(inclusive of one which is not converted to any of the 
above three special formats). The possibility in which 
the user can obtain the edited image becomes high. 
Furthermore, the image editing apparatus 1 de- 
20 scribed above is normally placed in the user's house. 
However, it may be disposed on streets, in front of 
stores, in stores and the like. 

As many apparently widely different embodiments 
of the present invention can be made without departing 
25 from the spirit and scope thereof, it is to be understood 
that the invention is not limited to the specific embodi- 
ments thereof except as defined in the appended 
claims. 
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I. A method of printing edited images in an image 
communication system in which an image server, 
an image editing apparatus and a printer server are 
capable of communicating with one another, com- 
prising the following steps in said image editing ap- 
paratus: 

generating an edited image of one frame using 
image data representing images of at least two 
frames; and 

transmitting information, whieff relates to gen- 
eration of the edited image, tafsaid image serv- 
er; 

the following steps in said image server: 
generating edited image data, which repre- 
sents the edited image, based upon the infor- 
mation relating to generation of the edited im- 
age transmitted from said image editing appa- 
ratus; and 

transmitting the edited image data that has 
been generated to said printer server; and 
the following step in said printer server: 
printing the edited image using the edited im- 
age data transmitted from said image server. 

2. The method according to claim 1 , further compris- 
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ing the steps of: 

storing image data, which represents images of 
a plurality of frames, in said image server; 
transmitting, from said image server to said im- s 
age editing apparatus on the basis of a trans- 
mission command from said image editing ap- 
paratus, image data representing images of at 
least two frames from among the images of the 
plurality of frames; 10 
generating, in said image editing apparatus, 
said edited image of one frame using the image 
data representing the images of at least two 
frames transmitted from said image server; 
transmitting, from said image editing apparatus *5 
to said image server as the information related 
to generation of the edited image, image iden- 
tification information for specifying the image 
data and information relating to editing of the 
edited image; and 20 
the following steps in said image server: 
retrieving, on the basis of the image identifica- 
tion information, the image data corresponding 
to the images of at least two frames that have 
been stored in said image server: and 2s 
generating the edited image data representing 
the edited image based upon the retrieved im- 
age data and the information relating to editing 
of the edited image. 

30 

3. The method according to claim 1 , further compris- 
ing the steps of: 

storing first image data, which is used in editing 
of an image, in said image server; 35 
storing second image data, which is used in ed- 
iting of an image, in said image editing appara- 
tus; 

transmitting the first image data from said im- 
age server to said image editing apparatus 40 
based upon a transmission command from said 
image editing apparatus; 
generating the edited image of one frame in 
said image editing apparatus using the first im- 
age data transmitted from said image server 45 
and the second image data that has been 
stored in said image editing apparatus; 
transmitting, from said image editing apparatus 
to said image server as the information relating 
to generation of the edited image, information so 
relating to editing of the edited image, image 
identification information for specifying the first 
image data, and the second image data that 
was used in the generation of the edited image; 
and 55 
the following steps in said image server: 
retrieving, on the basis of the image identifica- 
tion information, the first image data stored in 



said image server; and 

generating the edited image data representing 
the edited image based upon the retrieved first 
image data, the second image data transmitted 
from said image editing apparatus and the in- 
formation relating to generation of the edited 
image. 

4. The method according to claim 1 : further compris- 
ing the steps of: 

storing first image data, which represents im- 
ages of a plurality of frames, in said image serv- 
er, and transmitting, from said image server to 
said image editing apparatus, specific first im- 
age data, which represents an image of at least 
one Irame from among the images of the plu- 
rality of frames; 

storing second image data, which is used in ed- 
iting of an image, in said image editing appara- 
tus; 

generating the edited image of one frame in 
said image editing apparatus using the specific 
first image data transmitted from said image 
server and the second image data that has 
been stored in said image editing apparatus; 
transmitting, from said image editing apparatus 
to said image server as the information relating 
to generation of the edited image transmitted 
from said image editing apparatus to said im- 
age server, the information relating to editing of 
the edited image and image identification infor- 
mation for specifying the specific first image da- 
ta as well as the second image data; and 
the following steps in said image server: 
retrieving, on the basis of the image identifica- 
tion information, the specific first image data 
and the second image data from among the im- 
age data that has been stored in said image 
server; and 

generating the edited image data representing 
the edited image based upon the retrieved spe- 
cifidHirst image data and second image data 
and the information relating to generation of the 
edited image. 

5. The method according to claim 1, wherein image 
data representing images of a plurality of mutually 
corresponding frames has been stored in said im- 
age server and in said image editing apparatus, 
said method further comprising the steps of: 

generating, in said image editing apparatus, an 
edited image of one frame using images of at 
least two frames from among a plurality of im- 
ages represented by the image data that has 
been stored in said image editing apparatus; 
transmitting, from said image editing apparatus 
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to said image server as the information relating 
to generation of the edited image transmitted 
from said image editing apparatus to said im- 
age server, information relating to editing of the 
edited image and image identification informa- 
tion for specifying images of at least two frames 
that were used in generation of the edited im- 
age; and 

the following steps is said image server: 
retrieving, on the basis of the image identifica- 
tion information, image data representing imag- 
es corresponding to the images of at least two 
frames that were used in generation of the ed- 
ited image, the image data being retrieved from 
among the image data that has been stored in 
said image server and 

generating the edited image data representing 
the edited image from the retrieved image data 
representing the images of at least two frames 
and the information relating to generation of the 
edited image. 

6. The method according to claim 1 , further compris- 
ing the steps of: 

transmitting, from said image server to said im- 
age editing apparatus, image data for genera- 
tion of the edited image, said image data for 
generation of the edited image being thumbnail 
image data representing a thumbnail image; 
and 

generating the edited image data in said image 
server using printing image data having a res- 
olution higher than that of the thumbnail image 
data. 

7. The method according to claim 1 , further compris- 
ing the steps of: 

transmitting an authentication code from said 
image editing apparatus to said image server; 
determining, in said image server on the basis 
of the transmitted authentication code, whether 
transmission ol image data for generation of an 
edited image is allowed; and 
transmitting the image data for generation of an 
edited image from said image server to said im- 
age editing apparatus when transmission of the 
image data for generation of the edited image 
has been allowed. 

8. The method according to claim 3 in an image com- 
munication system which includes a plurality of said 
image servers, wherein when image data has not 
been retrieved by the retrieval carried out in a first 
image server based upon the image identification 
information, the retrieval is carried out in a second 
image server and the edited image data is general- 
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ed using the image data retrieved in the second im- 
age server. 

9. The method according to claim 4 in an image com- 
munication system which includes a plurality of said 
image servers, wherein when image data has not 
been retrieved by the retrieval carried out in a first 
image server based upon the image identification 
information, the retrieval is carried out in a second 
image server and the edited image data is generat- 
ed using the image data retrieved in the second im- 
age server. 

10. The method according to claim 5 in an image com- 
munication system which includes a plurality of said 
image servers, wherein when image data has not 
been retrieved by the retrieval carried out in a first 
image server based upon the image identification 
information, the retrieval is carried out in a second 
image server and the edited image data is generat- 
ed using the image data retrieved in the second im- 
age server. 

11. The method according to claim 1 ; lurther compris- 
ing the steps of: 

storing image data representing a plurality of 
images in said image server; and 
the following steps in said image server: 
retrieving image data, which is for generating 
the edited image, based upon the information 
relating to generation of the edited image; 
determining whether the retrieved image data 
for generating the edited image is image data 
requiring billing; 
adding information relating to billing onto the 
edited image data when it has been determined 
that the image data for generating the edited 
image is image data requiring billing; and 
storing the information relating to billing in said 
image server and in said printer server. 



12 



The method according to claim 1, wherein when 
printing of the edited image in said printer server 
45 has been suspended, information relating to sus- 
pension of printing of the edited image is transmit- 
ted to at least one of said image editing apparatus 
and image server. 

so 13. The method according to claim 11, wherein when 
printing of the edited image in said printer server 
has been suspended, the information relating to bill- 
ing that has been stored in said image server and 
in said printer server is deleted. 

14. The method according to claim 11, wherein when 
payment based upon the information relating to bill- 
ing has been received, information relating to re- 
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ceipt of the payment is stored in said image server. 

15. The method according to claim 1, wherein when a 
fee for using said image server has been received, 
information relating to receipt of the fee is transmit- 
ted from said image server to said printer server. 

16. The method according to claim 1, wherein when a 
fee for using said printer server has been received, 
information relating to receipt of the fee is transmit- 
ted from said printer server to said image server. 

17. The method according to claim 15, wherein the in- 
formation relating to receipt of the fee is transmitted 
upon being encrypted. 

18. The method according to claim 16, wherein the in- 
formation relating to receipt of the fee is transmitted 
upon being encrypted. 

19. The method according to claim 1. wherein image 
data has been stored on a portable storage medi- 
um, said method further comprising the steps of: 

reading the image data out of the portable stor- 
age medium by said image editing apparatus; 
and 

generating the edited image of one frame using 
the image data that has been read out. 

20. The method according to claim 19, wherein the im- 
age data that has been stored on said portable stor- 
age medium is thumbnail image data representing 
a thumbnail image. 

21. The method according to claim 19, wherein image 
data other than image data requiring billing is stored 
on said portable storage medium. 

22. The method according to claim 1 , wherein said im- 
age server and said printer server constitute a sin- 
gle apparatu^. 

23. The method according to claim 1 , further compris- 
ing the steps of: 

transmitting image data tor generation of the 
edited image and information relating lo billing 
corresponding to this image data for generation 
of the edited image from said image editing ap- 
paratus to said image server; and 
the following steps in said image server: 
storing the image data for generation of the ed- 
ited image and the information relating to billing 
corresponding to this image data for generation 
of the edited image; and 

when the edited image data has been generat- 
ed using the image data for generation of the 



edited image, relating the corresponding infor- 
mation relating to billing with said edited image 
data. 

5 24. The method according to claim 23, further compris- 
ing the steps ol: 

modifying the information relating to billing that 
corresponds to the image data for generation 
io of the edited image; and 

relating the information relating to billing that 
has been modified with said edited image data. 

25. The method according to claim 1 , wherein the im- 
75 age data representing the image of one frame from 
among the images of at least two frames is template 
image data representing background of images 
constituting the edited image. 

20 26. The method according lo claim 23, further compris- 
ing a step of counting, in said image server, the 
number of times the image data for generation of 
the edited image is used: 

wherein a fee for using the image datafor gen- 

25 eration of the edited image decided by the informa- 

tion relating to billing that corresponds to said image 
data for generation of the edited image is set so as 
to decrease as the number of times said image data 
is used increases 

30 

27. The method according to claim 23, further compris- 
ing the steps of: 

deciding, in advance, individuals who are capa- 
35 ble of using, free of charge, the image data for 

generation of the edited image: and 
in response to presence of data representing 
an individual who is capable of using, free of 
charge, the image data for generation of the ed- 
40 ited image, halting the relating of the corre- 

sponding information relating to billing with the 
edited image data. 

28. The method according to claim 1 : further compris- 
es ing the steps of: 

providing an authentication server; 
determining, by said authentication server, 
whether said image editing apparatus, said im- 
50 age server and said printer server are legiti- 

mate; and 

when it is determined that they are legitimate, 
validating communication among said image 
editing apparatus, said image server and said 
55 printer server. 

29. The method according to claim 1 , wherein said im- 
age editing apparatus and said printer server are 
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the same apparatus. 

30. The method according to claim 29, wherein printing 
of an edited image by said printer server is allowed 
up to a limited number of times represented by lim- 
itation data which limits the number of times the ed- 
ited image represented by the edited image data is 
printed. 

31. The method according to claim 1, further compris- 
ing a step of transmitting, Irom said image server to 
said image editing apparatus, data relating to status 
of generation ol edited image data in said image 
server. 

32. An article produced by the method of printing edited 
images set forth in claim 1 . 

33. A method of printing an edited image in an image 
communication system in which an image editing 
apparatus and a printer server are capable of com- 
municating with each other, comprising the steps of: 

storing image data representing images of a 
plurality of frames in said image editing appa- 
ratus 

generating, in said image editing apparatus, an 
edited image of one frame using image data 
representing images of at least two frames from 
among the stored image data; 
transmitting edited image data representing the 
generated edited image to said printer server; 
and 

printing the edited image in said printer server 
using the edited image data that has been 
transmitted. 



34. The method according to claim 33, wherein the im- 
age data representing the images of the plurality of 
frames has been stored on a portable storage me- 
dium, the image data that has been stored on said 
portable storage medium being read out to thereby 
store said image data in said image editing appara- 
tus. 

35. The method according to claim 1 .further comprising 
a step of transmitting, to said image editing appa- 
ratus, edited image data generated by said image 
server. 

36. The method according to claim 1 ,f urther comprising 
a step of converting a format of edited image data 
generated by said image server to a different 
format . 

37. In an image communication system in which an im- 
age server, an image editing apparatus and a print- 
er server are capable of communicating with one 



another, a system for printing edited images in 
which said image editing apparatus comprises: 

image editing means for generating an edited 
£ image of one frame using image data repre- 

senting images of at least two frames; and 
edited-image generating information transmit- 
ting means for transmitting information, which 
relates to generation of the edited image gen- 
10 erated by said image editing means, to said im- 

age server; 

said image server comprises: 
edited image data generating means for gener- 
ating edited image data, which represents the 
75 edited image, based upon the information re- 

lating to generation of the edited image trans- 
mitted from said image editing apparatus; and 
edited image data transmitting means for trans- 
mitting the edited image data, which has been 
generated by said edited image dala generat- 
ing means, to said printer server; and 
said printer server has printing means for print- 
ing the edited image using the edited image da- 
ta transmitted from said image server. 

38. The system according to claim 37, wherein said im- 
age server stores image data, which represents im- 
ages of a plurality of frames, and transmits, to said 
image editing apparatus on the basis of a transmis- 
sion command from said image editing apparatus, 
image data representing images of at least two 
frames from among the images of the plurality of 
frames; 

said image editing means of said image editing 
apparatus generates the edited image ol one 
frame using the image data representing the 
images of at least two frames transmitted from 
said image data transmitting means of said im- 
40 age server; 

said edited-image generating information 
transmitting means transmits, from said image 
editing apparatus to said innate server, infor- 
mation relating to editing of the edited image 
45 edited by said image editing means, and image 

identification information for specifying the im- 
age data transmitted from said image server; 
and 

said edited image data generating means of 
so said image server retrieves the image data cor- 

responding to the images of at least two frames 
based upon the image identification information 
transmitted from said edited-image generating 
information transmitting means, and generates 
55 the edited image data representing the edited 

image based 'upon the retrieved image data 
and the information relating to editing of the ed- 
ited image. 
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39. The system according to claim 37, wherein said im- 
age server stores first image data used in editing ot 
an image and said image editing apparatus stores 
second image data used in editing of an image; 

said image server transmits the first image data 
to said image editing apparatus based upon a 
transmission command from said image editing 
apparatus; 

said image editing means of said image editing 
apparatus generates the edited image of one 
frame using the first image data transmitted 
from said image server and the second image 
data that has been stored in said image editing 
apparatus; 

said edited-image generating information 
transmitting means transmits, to said image 
server, information relating to generation of the 
edited image, image identification information 
for specifying the first image data, and the sec- 
ond image data that was used in the generation 
of the edited image in said image editing appa- 
ratus; and 

said edited image data generating means of 
said image server retrieves the first image data, 
which has been stored in said image server, 
based upon the image identification informa- 
tion, and generates the edited image data rep- 
resenting the edited image based upon the re- 
trieved first image data, the second image data 
transmitted from said image editing apparatus 
and the information relating to generation of the 
edited image. 

40. The system according to claim 37, wherein said im- 
age server stores first image data, which represents 
images of a plurality of frames; 

said image editing apparatus stores second im- 
age data representing an image; 
said image server transmits, to said image ed- 
iting apparatus, specific first image data, which 
represents an image of at least one frame 
among the images of the plurality of frames; 
said image editing means of said image editing 
apparatus generates the edited image of one 
frame using the specific first image data trans- 
milted from said image server and the second 
image data that has been stored in said image 
editing apparatus; 

said edited-image generating information 
transmitting means transmits, to said image 
server, the information relating to generation of 
the edited image, and image identification in- 
formation for specifying the specific first image 
data as well as the second image data; and 
the edited image data generating means of said 
image server retrieves, on the basis of the im- 



age identification information, the specific first 
image data and the second image data from 
among the image data that has been stored in 
said image server, and generates the edited im- 
£ age data representing the edited image based 

upon the retrieved first image data and second 
image data and the information relating to gen- 
eration of the edited image. 

to 41. The system according to claim 37, wherein image 
data representing images of a plurality of mutually 
corresponding frames has been stored in said im- 
age server and in said image editing apparatus; 

15 said image editing means of said image editing 

apparatus generates an edited image of one 
frame using images of at least two frames from 
among a plurality of images represented by the 
image data that has been stored in said image 
20 editing apparatus; 

said edited-image generating information 
transmitting means transmits, to said image 
server, information relating to generation of the 
edited image and image identification informa- 
25 tion for specifying images of at least two frames 

that were used in generation of the edited im- 
age; and 

said edited image data generating means of 
said image server retrieves, on the basis of the 
30 image identification information, image data 

representing images corresponding to the im- 
ages of at least two frames that were used in 
generation of the edited image, the image data 
being retrieved from among the image data that 
3S has been stored in said image server, and gen- 

erating the edited image data representing the 
edited image from the retrieved image data rep- 
resenting the images of at least two frames and 
the information relating to generation of the ed- 
40 jted image. 

42. The system according to claim 37, wherein said im- 
age server transmits, tojbaid image editing appara- 
tus, image data for generation of the edited image, 

45 said image data for generation of the edited image 
being thumbnail image data representing a thumb- 
nail image, and 

said edited image data generating means 
generates the edited image data using printing im- 
so age data having a resolution higher than that of the 
thumbnail image data. 

43. The system according to claim 37, further having 
authentication code transmitting means for trans- 

55 mitting an authentication code to said image server; 

said image server further comprising determi- 
nation means for determining, on the basis of 
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the authentication code transmitted trom said 
authentication code transmitting means, 
whether transmission of image data for gener- 
ation of an edited image to said image editing 
apparatus is allowed: and 
wherein when it has been determined by said 
determination means that transmission of the 
image data for generation of the edited image 
is allowed, said image server transmits the im- 
age data for generation of the edited image to 
said image editing apparatus. 

44. The system according to claim 37, wherein the im- 
age communication system includes a plurality of 
said image servers, and said image servers further 
comprise control means lor controlling said edited 
image data generating means in such a manner that 
when image data has not been retrieved by the re- 
trieval carried out in a first image server based upon 
the image identification information, the retrieval is 
carried out in a second image server and the edited 
image data is generated using the image data re- 
trieved in the second image server. 

45. The system according to claim 37, wherein said im- 
age server stores image data representing a plural- 
ity of images and further comprises: 

retrieval means for retrieving, from the stored 
image data on the basis of the information re- 
lating to generation of the edited image, image 
data for generating the edited image; 
billing determination means for determining 
whether the image data retrieved by said re- 
trieval means is image data requiring billing; 
billing information add-on means for adding in- 
formation relating to billing onto the edited im- 
age data when said billing determination 
means has determined that the image data for 
generating the edited image is image data re- 
quiring billing; and 

billing information, storage control means for 
storing the information relating to billing and 
causing the information relating to billing to be 
stored in said printer server. 



been stored in said image server and in said printer 
server when printing of the edited image in said 
printer server has been suspended. 

5 48. The system according to claim 45, further compris- 
ing information relating to billing add-on means for 
adding on information, which has been stored in 
said image server, relating to receipt of payment 
when payment based upon the information relating 
10 to billing has been received. 

49. The system according to claim 37, further compris- 
ing first user-fee receipt information transmitting 
means which, when a fee for using said image serv- 

75 er has been received, is tor transmitting information 
relating to receipt of this fee from said image server 
to said printer server. 

50. The system according to claim 37, further compris- 
20 ing second user-fee receipt information transmitting 

means which, when a fee for using said printer serv- 
er has been received, is for transmitting information 
relating to receipt of this tee from said printer server 
to said image server. 
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51. The system according to claim 49, wherein the in- 
formation relating to receipt of the fee has been en- 
crypted. 

52. The system according to claim 50, wherein the in- 
formation relating to receipt of the fee has been en- 
crypted. 

53. The system according to claim 37, wherein said im- 
age editing apparatus further comprises readout 
means for reading the image data out of a portable 
storage medium on which image data has been 
stored; and 

■ said edited image generating means gener- 
40 ates the edited image of one frame using the image 
data read out 1rom said readout means. 

54. The system according to claim 53, wherein the im- 
age data that has been stored on said portable stor- 
es age medium is thumbnail image data representing 

a thumbnail image. 



46. The system according to claim 37, wherein said 
printer server further comprises printing suspension 
information transmitting means for transmitting in- 
formation, which relates to suspension of printing of 
the edited image, to at least one of said image ed- 
iting apparatus and image server when printing of 
the edited image in said printer server has been 
suspended. 

47. The system according to claim 45, further compris- 
ing information relating to billing deleting means for 
deleting the information relating to billing that has 
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The system according to claim 53, wherein image 
data other than image data requiring billing is stored 
on said portable storage medium. 
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56. The system according to claim 37, wherein said im- 
age server and said printer server constitute a sin- 
gle apparatus. 

57. The system according to claim 37, wherein said im- 
age editing apparatus further comprises informa- 
tion relating to billing transmitting means for trans- 



33 



BNSDOCID: <EP 086O986A2_l_> 



65 



EP 0 860 986 A2 



66 



mitting. to said image server, image data for gener- 
ation of the edited image and information relating to 
billing corresponding to this image data for genera- 
tion of the edited image; and 

5 

said image server further comprises: 
billing information storage means for storing the 
image data for generation of the edited image 
data, and the information relating to billing cor- 
responding to this image data for generation of 10 
the edited image, which image data and infor- 
mation relating to billing have been transmitted 
by said information relating to billing transmit- 
ting means; and 

relating means, responsive to generation of the is 
edited image data using the image data for gen- 
eration of the edited image, for relating the cor- 
responding information relating to billing, which 
has been stored in said information relating to 
billing storage means, with the edited image da- 20 
ta. 

58. The system according to claim 57, wherein said im- 
age server further comprises information relating to 
billing modifying means for modifying the informa- 2s 
tion relating to billing that corresponds to the image 
data for generation of the edited image; and 

said relating means relates the information re- 
lating to billing that has been modified with said ed- 
ited image data. 30 

59. The system according to claim 37, wherein the im- 
age data representing the image of one frame from 
among the images of at least two frames is template 
image data representing background of images 35 
constituting the edited image. 

60. The system according to claim 57, wherein said im- 
age server further comprises counting means for 
counting the number of times the image data for *o 
generation of the edited image is used; and 

a fee for using the image data for generation 
of the edited image/decided by the information re- 
lating to billing that corresponds to said image data 
tor generation of the edited image is set so as to 45 
decrease as the number of times said image data 
is used increases. 

61. The system according to claim 57, wherein individ- 
uals who are capable of using, free of charge, the so 
image data for generation of the edited image have 
been decided in advance; and 

said relating means responding to presence 
of data representing an individual who is capable of 
using, tree of charge, the image data for generation ss 
of the edited image, by halting the relating of the 
corresponding information relating to billing with the 
edited image data. 



62. The system according to claim 37, further compris- 
ing an authentication server having authorization 
means for determining whether said image editing 
apparatus, said image server and said printer serv- 
er are legitimate; 

wherein communication among said image 
editing apparatus, said image server and said print- 
er server is enabled in response to a determination 
by said authentication server that they are legiti- 
mate. 

63. The system according to claim 37, wherein said im- 
age editing apparatus and said printer server are 
the same apparatus. 

64. The system according to claim 62, wherein said 
printer server is allowed to print the edited image 
up to a limited number ol times represented by lim- 
itation data which limits the number of times the ed- 
ited image represented by the edited image data is 
printed. 

65. The system according to claim 37, wherein data re- 
lating to status of generation of edited image data 
in said image server is transmitted from said image 
server to said image editing apparatus. 

66. An article produced by the system for printing edited 
images set forth in claim 37. 

67. In an image communication system in which an im- 
age editing apparatus, which has image data stor- 
age means in which image data representing imag- 
es of a plurality of frames has been stored, and a 
printer server are capable of communicating with 
each other, a system for printing edited images in 
which said image editing apparatus comprises: 

image editing means for generating edited im- 
age of one frame using image data represent- 
ing images of at least two frames from among 
the image data that has been stored in said im- 
age data storage means; and 
edited image data transmitting means for trans- 
mitting, to said printer server, edited image data 
representing the edited image generated by 
said image editing means; 
said printer server having printing means for 
printing the edited image using the edited im- 
age data that has been transmitted. 

68. The system according to claim 67, further compris- 
ing: 

image data readout means for reading out im- 
age data that has been stored on a portable 
storage medium; and 

storage control means for causing the image 
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receive image data representing images of at 
least two frames; 

generate an edited image of one frame using 
the image data representing the images of two 
frames; and 

transmit, to an image server, information relat- 
ing to editing that has been performed, and im- 
age identification data for specifying the image 
data that has been received. 

An image editing apparatus used in an image com- 
munication system constituted by an image server 
the image editing apparatus and a printer server 
that are capable of communicating with one anoth- 
er; 
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data, which has been read out by said image 
data readout means, in said image data storage 
means. 

69. The system according to claim 37, further compris- s 
ing edited image data transmitting means for trans- 
mitting edited image data generated by said image 
server to said image editing apparatus. 

70. The system according to claim 37, further compris- io 

ing image data converting means for converting a 74. 
format of edited image data generated by said im- 
age server to a different format. 

71. An image editing apparatus used in a system con- *5 
stituted by the image editing apparatus, an image 
server having image data storage means in which 
image data representing images of a plurality of 
i-nmcs has been stored and image data transmit- 
l ng means for transmitting image data, which rep- 
lu^ciiib images of at least two Irames from among 
nc irrvigcs ol the plurality of frames, to said image 
edit ng rippruatus based upon a transmission com- 
mand Irom said image editing apparatus, and a 
prmicr server said image editing apparatus, said 
imago server and said printer server being capable 
ol communicating with one another, said image ed- 
iting apparatus comprising: 
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image editing means for generating an edited 
image of one frame using image data repre- 
senting images of at least two frames transmit- 
ted from said image data transmitting means of 
said image server; and 

image generating data transmitting means for 
transmitting, to said image server, information 
relating to editing performed by said image ed- 
iting means, and image identification data for 
specifying the image data that has been trans- 
mitted from said image server. 
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72. An image editing apparatus comprising: 

image editing means for receiving image data 
representing images of at least two frames and 
generating an edited image of one frame using 
the image data representing the images of two 
frames; and 

image generating data transmitting means for 
transmitting, to an image server, information re- 
lating to editing performed by said image edit- 
ing means, and image identification data for 
specifying the image data that has been re- 
ceived. 

73. A computer-readable recording medium storing a 
program for controlling a computer of an image ed- 
iting apparatus so as to: 



wherein said image server has first image data 
storage means in which first image data used 
in editing of an image has been stored and 
transmits the first image data lo said image ed- 
iting apparatus on the basis of a transmission 
command from said image editing apparatus, 
and said image editing apparatus has second 
image data storage means in which second im- 
age data used in editing of an image has been 
stored; 

said image editing apparatus comprising: 
image editing means for generating an edited 
image of one frame using the using the first im- 
age data that has been transmitted from said 
image server and the second image data that 
has been stored in said image editing appara- 
tus: and 

image generating data transmitting means for 
transmitting, to said image server, information 
relating to generation of the edited image, im- 
age identification information for specifying the 
first image data, and the second image data 
that was used in the generation of the edited 
image in said image editing means. 

75. An image editing apparatus comprising: 

% > * 

image editing means 1or generating an edited 
45 image of one frame using first image data that 

has been transmitted from an image server and 
second image data that has been stored in the 
image editing apparatus; and 
image generating data transmitting means for 
so transmitting, to said image server, information 

relating to generation of the edited image, im- 
age identification information for specifying the 
first image data, and the second image data 
that was used in the generation of the edited 
55 image in said image editing means. 

76. A computer-readable recording medium storing a 
program for controlling a computer of an image ed- 
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iting apparatus so as to: 

receive first image data; 
generate an edited image of one frame using 
the received first image data and second image $ 
data that has been stored in the image editing 
apparatus; and 

transmit, from said image editing apparatus to 
an image server, information relating to gener- 
ation of the edited image, image identification 10 
information for specifying the first image data, 
and the second image data that was used in 
generation of the edited image in said image 
editing means. 

15 

77. An image editing apparatus used in an image com- 
munication system constituted by an image server, 
the image editing apparatus and a printer server 
that are capable of communicating with one anoth- 
er; 20 

wherein said image server has first image data 
storage means in which first image data repre- 
senting image of a plurality of frames has been 
stored and transmits specific first image data, 25 
which represents an image of at least one 
frame from among the images of the plurality of 
frames, to said image editing apparatus on the 
basis of a transmission command from said im- 
age editing apparatus, and said image editing 30 
apparatus has second image data storage 
means in which second image data used in ed- 
iting of an image has been stored: 
said image editing apparatus comprising: 
image editing means for generating an edited 35 
image of one frame using the first image data 
that has been transmitted from said image serv- 
er and the second image data that has been 
stored in said second image data storage 
means; and 

image generating data transmitting means for 
transmitting, from said image editing apparatus 
to said image server, information relating to 
generation of the edited image, and image 
identification information for specifying the first 4 $ 
image data and the second image data. 

78. An image editing apparatus comprising: 

image data receiving means for receiving first 50 
image data; 

image data storage means in which second im- 
age data has been stored; 
image editing means for generating an edited 
image of one frame using the first image data 55 
received by said image data receiving means 
and the second image data that has been 
stored in said image data storage means; and 



image generating data transmitting means for 
transmitted, to an image server, information re- 
lating to generation of the edited image, and im- 
age identification information for specifying the 
first image data and the second image data. 

79. A computer-readable recording medium storing a 
program for controlling a computer ol an image ed- 
iting apparatus so as to: 

receive first image data; 
generate an edited image of one frame using 
the first image data that has been received and 
second image data that has been stored; and 
transmit, to an image server, information relat- 
ing to generation of the edited image, and im- 
age identification information for specifying the 
first image data and the second image data. 

80. An image editing apparatus used in an image com- 
munication system constituted by the image editing 
apparatus and a printer server capable of commu- 
nicating with each other, wherein said image editing 
apparatus comprises: 

image data storage means in which image data 
representing images of a plurality of frames has 
been stored; 

image editing means for generating an edited 
image of one frame using image data repre- 
senting images of at least two frames from 
among the image data that has been stored in 
said image data storage means; and 
edited image data transmitting means for trans- 
mitting, to said printer server, editing image da- 
ta representing the edited image generated by 
said image editing means. 

81. An image editing apparatus comprising: 

image data storage means in which image data 
representing images of a plurality of frames has 
been stcfred; 

image editing means for generating an edited 
image of one frame using image data repre- 
senting images of at least two frames from 
among the image data that has been stored in 
said image data storage means; and 
edited image data transmitting means for trans- 
mitting, to a printer server, editing image data 
representing the edited image generated by 
said image editing means. 

82. A computer-readable recording medium storing a 
program for controlling a computer ol an image ed- 
iting apparatus so as to: 

generate an edited image of one frame using 
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image data representing images of at least two 
frames Irom image data storage means in 
which image data representing image of a plu- 
rality of frames has been stored: and 
transmit, to a printer server, edited image data 
representing the edited image that has been 
generated. 

83. An image editing apparatus used in an image com- 
munication system in which an image server, which 
has first image data storage means in which image 
data representing images of a plurality of frames 
has been stored, the image editing apparatus, 
which has second image data storage means in 
which image data representing images of a plurality 
of frames has been stored, and a printer are capa- 
ble of communicating with one another, said image 
editing apparatus comprising: 

image editing means for generating an edited 20 
image of one frame using images of at least two 
frames from among images represented by im- 
age datathat has been stored in said first image 
data storage means; and 

image generating data transmitting means for 2s 
transmitting, to said image server, information 
relating to generation of the edited image, and 
image identification information for specifying 
images of at least two frames that were used in 
generation of the edited image. 30 

84. An image editing apparatus comprising: 

image data strage means in which image data 
representing images of a plurality of frames has 35 
been stored; 

image editing means for generating an image 
of one frame using images of at least two 
frames from among images represented by the 
image data that has been stored in said image *o 
data storage means; and 
image generating data transmitting means for 
transmitting, to an im%ge server,- information re- 
lating to generation ol the edited image, and im- 
age identification information lor specifying im- «5 
ages of at least two frames that were used in 
generation of the edited image. 

85. A computer-readable recording medium storing a 

program for controlling a computer of an image ed- so 
iting apparatus so as to: 

generate an edited image of one frame using 
images of at least two frames from among im- 
ages represented by image data that has been ss 
stored in image data storage means in which 
image data representing images of a plurality 
of frames has been stored; and 



transmit, to an image server, information relat- 
ing to generation o1 the edited image, and im- 
age identification information for specifying im- 
ages of at least two frames that were used in 
generation of the edited image. 

An image server used in a system constituted by an 
image editing apparatus, the image server, which 
has image data storage means in which image data 
representing images of a plurality of frames has 
been stored and image data transmitting means for 
transmitting image data, which represents images 
of at least two frames from among the images of the 
plurality of frames, to said image editing apparatus 
based upon a transmission command from said im- 
age editing apparatus, and a printer server, said im- 
age editing apparatus, said image server and said 
printer server being capable of communicating with 
one another, said image server comprising: 

image generating data receiving means tor re- 
ceiving, from said image editing apparatus, in- 
formation relating to editing of an edited image 
of one frame generated in said image editing 
apparatus using image data representing imag- 
es of at least two frames transmitted from said 
image data transmitting means of said image 
server, and image identification data for speci- 
fying the image data that has been transmitted 
from said image server; 
edited image data generating means for retriev- 
ing image data, which corresponds to the im- 
ages of at least two frames that have been 
stored in the image data storage means includ- 
ed in said image server, on the basis of the im- 
age identification information transmitted from 
said image generating data transmitting 
means, and generating edited image data, 
which represents the edited image, on the basis 
of the image data that has been received and 
information relating to generation of the edited 
image; and 

edited image data transmitting means for trans- 
mitting the edited image data to said printer 
server in order to print the edited image using 
the edited image data that has been generated 
by said edited image generating means. 

87. An image server comprising: 

image data storage means for storing image 
data; 

image generating data receiving means for re- 
ceiving information relating to editing of an ed- 
ited image of one frame generated using image 
data representing images of at least two 
frames, and image identification data for spec- 
ifying image data; 
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edited image data generating means for retriev- 
ing image data, which corresponds to the im- 
ages of at least two frames that have been 
stored in said image data storage means, on 
the basis of the image identification informa- 
tion, and generating edited image data, which 
represents the edited image, on the basis of the 
image data that has been received and infor- 
mation relating to generation of the edited im- 
age; and 

edited image data transmitting means for trans- 
mitting the edited image data to said printer 
server in order to print the edited image using 
the edited image data that has been generated 
by said edited image generating means. 

88. A computer-readable recording medium storing a 
program tor controlling a computer of an image 
server so as to: 

icceive information relating to editing of an ed- 
ited image of one frame generated using image 
data representing images of at least two 
frames and image identification information for 
specifying image data; 

r etrieving image data, which corresponds to the 
images of at least two frames that have been 
stored in image data storage means, on the ba- 
sis of the image identification information, and 
generating edited image data, which repre- 
sents the edited image, on the basis of the im- 
age data that has been received and informa- 
tion relating to generation of the edited image: 
and 

transmit the edited image data to a printer serv- 
er in order to print the edited image using the 
edited image data that has been generated. 

89. An image server used in an image communication 
system constituted by the image server, in which 
first image data used in editing of an image has 
been stored, an image editing apparatus, in which 
second imacfe data used in editing of an image has 
been stored, and a printer server, said image server, 
said image editing apparatus and said printer server 
being capable of communicating with one another; 

first image data transmitting means for trans- 
mitting the first image data to said image editing 
apparatus on the basis of a transmission com- 
mand from said image editing apparatus; 
image generating data receiving means for re- 
ceiving, from said image editing apparatus : in- 
formation relating to generation of an edited im- 
age of one frame generated in said image ed- 
iting apparatus using the first image data trans- 
mitted from said first image data transmitting 
means and the second image data that has 



been stored in said image editing apparatus, 
image identification information for specifying 
the first image data, and the second image in- 
formation that was used in generation of the ed- 
ited image; 

edited image data generating means for retriev- 
ing the first image data, which has been stored 
in said first image data storage means, on the 
basis of the image identification information, 
and generating edited image data, which rep- 
resents the edited image, on the basis of the 
first image data that has been retrieved, the 
second image data that has been transmitted 
from said image editing apparatus, and infor- 
mation relating to generation of the edited im- 
age; and 

transmitting means for transmitting the edited 
image data to said printer server in order to print 
the edited image using the edited image data 
that has been generated. 

90. An image server comprising: 

image data storage means in which first image 
data used in editing of an image has been 
stored; 

image data transmitting means for transmitting 
the first image data to an image editing appa- 
ratus on the basis of a transmission command; 
image generating data receiving means for re- 
ceiving, from said image editing apparatus, in- 
formation relating to generation of an edited im- 
age of one frame generated in said image ed- 
iting apparatus using the first image data trans- 
mitted from said first image data transmitting 
means and the second image data that has 
been stored in said image editing apparatus, 
image identification information for specifying 
the first image data, and the second image data 
that was used in generation of the edited image; 
edited image data generating means for retriev- 
ing the first image data, which has been stored 
in said first image data storage means, on the 
basis of the image identification information, 
and generating edited image data, which rep- 
resents the edited image, on the basis of the 
first image data that has been retrieved, the 
second image data that has been transmitted 
from said image editing apparatus, and infor- 
mation relating to generation of the edited im- 
age; and 

transmitting means for transmitting the edited 
image data to said printer server in order to print 
the edited image using the edited image data 
that has been generated. 

91. A computer-readable recording medium storing a 
program for controlling a computer of an image 
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server so as to: 



transmit first image data to an image editing ap- 
paratus on the basis of a transmission com- 
mand; 

receive, from said image editing apparatus, in- 
formation relating to generation of an edited im- 
age of one frame generated in said image ed- 
iting apparatus using the first image data that 
has been transmitted and the second image da- 
ta that has been stored in said image editing 
apparatus, image identification information for 
specifying the first image data, and the second 
image data that was used in generation ol the 
edited image; 

retrieve the first image data on the basis ol the 
image identification information and generate 
edited image data, which represents the edited 
image, on the basis of the first image data that 
has been retrieved, the second image data lhat 
has been transmitted from said image editing 
apparatus, and information relating to genera- 
tion of the edited image; and 
transmit the edited image data to a printer serv- 
er in order to print the edited image using the 
edited image data that has been generated. 

92. An image server used in an image communication 
system constituted by the image server, which has 
first image data storage means in which image data 
representing images of a plurality of frames has 
been stored, an image editing apparatus having 
second image data storage means in which second 
image data representing an image has been stored, 
and a printer server, said image server, said image 
editing apparatus and said printer server being ca- 
pable of communicating with one another, said im- 
age server comprising: 

first image data transmitting means for trans- 
mitting, to said image editing apparatus, first 
image data representing an image of at least 
one frame from among the images of the plu- 
rality ol Irames that have been stored in said 
first image data storage means; 
image generating data receiving means for re- 
ceiving, 1rom said image editing apparatus, in- 
formation relating to generation of an edited im- 
age of one frame generated in said image ed- 
iting apparatus using the first image data trans- 
mitted from said first image data transmitting 
means and the second image data that has 
been stored in said image editing apparatus, 
and image identification information for speci- 
fying the first image data and the second image 
data; 

edited image data generating means for retriev- 
ing, on the basis of the image identification in- 



formation, the first image data and the second 
image data from among image data that has 
been stored in said image server, and generat- 
ing edited image data representing the edited 
s image on the basis of the first image data and 

second image data that has been retrieved and 
the image identification information; and 
edited image data transmitting means for trans- 
mitting the edited image data to said printer 
w server in order to print the edited image using 

the edited image data that has been generated. 

93. An image server comprising: 

7 £ first image data storage means in which image 

data representing images of a plurality of 
frames has been stored; 
first image data transmitting means for trans- 
mitting, to an image editing apparatus in which 
20 second image data has been stored, first image 

data representing an image of at least one 
frame from among the images of the plurality of 
frames that have been stored in said first image 
data storage means; 
2 s image generating data receiving means for re- 

ceiving, from said image editing apparatus, in- 
formation relating to generation of an edited im- 
age of one frame generated in said image ed- 
iting apparatus using the first image data trans- 
30 mitted from said first image data transmitting 

means and the second image data that has 
been stored in said image editing apparatus, 
and image identification information for speci- 
fying the first image data and the second image 

35 data; 

edited image data generating means for retriev- 
ing, on the basis of the image identification in- 
formation, the first image data and the second 
image data from among image data that has 
40 been stored in said image server, and generat- 

ing edited image data representing the edited 
image on the basis of the first image data and 
second imagejdata that has been retrieved and 
the image identification inlorrrtation; and 
as edited image data transmitting means for trans- 

mitting the edited image data to said printer 
server in order to print the edited image using 
the edited image data lhat has been generated. 

94. A computer-readable recording medium storing a 
program for controlling a computer of an image 
server so as to: 

transmit first image data representing an image 
55 to an image editing apparatus in which second 

image data has been stored; 
receive, from said image editing apparatus, in- 
formation relating to generation of an edited im- 
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age of one frame generated in said image ed- 
iting apparatus using the first image data and 
the second image data, which has been stored 
in said image editing apparatus, and image 
identification information for specifying the first s 
image data and the second image data; 
retrieve, on the basis of the image identification 
information, the first image data and the second 
image data from among image data that has 
been stored in the image server, and generate fo 
edited image data representing the edited im- 
age on the basis ol the first image data and sec- 
ond image data that has been retrieved and the 
image identification information; and 
transmit the edited image data to a printer serv- is 
er in order to print the edited image using the 
edited image data that has been generated. 

95. A printer server used in an image communication 
system constituted by an image editing apparatus, 20 
which has image data storage means in which im- 
age data representing images of a plurality of 
frames has been stored, and a printer server capa- 
ble of communicating with each other, wherein said 
printer server comprises: 25 

edited image data receiving means for receiv- 
ing edited image data representing an edited 
image of one frame that has been generated 
using image data representing images of at 30 
least two frames from among the image data 
that has been stored in said image data storage 
means; and 

printing means for printing the edited image us- 
ing the edited image data. 35 

96. A printer server comprising: 

edited image data receiving means for receiv- 
ing edited image data representing an edited 40 
image of one frame that has been generated 
using image data representing images of at 
least two frames; and 

printing means for printing the edited image us- 
ing the edited image data. 45 

97. A computer-readable recording medium storing a 
program for controlling a computer of a printer serv- 
er so as to: 

so 

receive edited image data representing an ed- 
ited image of one frame generated using image 
data representing images of at least two 
frames: and 

print the edited image using the edited image ss 
data. 

98. An image server used in an image communication 



system constituted by the image server which has 
first image data storage means in which image data 
representing images of a plurality of frames has 
been stored, an image editing apparatus having 
second image data storage means in which image 
data representing images of a plurality of frames 
has been stored, and a printer server, said image 
server, said image editing apparatus and said print- 
er server being capable of communicating with one 
another, said image server comprising: 

image generating data receiving means for re- 
ceiving, from said image editing apparatus, in- 
formation relating to generation of an edited im- 
age of one frame generated using images of at 
least two frame from among image of a plurality 
of frames represented by image data that has 
been stored in said first image data storage 
means, and image identification information for 
specifying images of at least two frames that 
were used in generation of the edited image: 
edited image data generating means for retriev- 
ing, on the basis of the image identification in- 
formation, image data representing images of 
at least two frames, which were used in gener- 
ation of the edited image, from among image 
data that has been stored in said second image 
data storage means, and generating edited im- 
age data representing the edited image on the 
basis of the retrieved image data, which repre- 
sents the images of at least two frames, and the 
image identification information: and 
edited image data transmitting means for trans- 
mitting the edited image data to said printer 
server in order to print the edited image using 
the edited image data that has been generated. 

99. An image server comprising: 

first image data storage means in which image 
data representing images of a plurality of 
frames has been stored; 
image generating data receiving means for re- 
ceiving information relating to generation of an 
edited image of one frame generated using im- 
ages of at least two frames from among images 
represented by image data that has been 
stored in said first image data storage means, 
and image identification information for speci- 
fying images of at least two frames that were 
used in generation of the edited image; 
edited image data generating means for retriev- 
ing, on the basis of the image identification in- 
formation, image data representing images of 
at least two frames, which were used in gener- 
ation of the edited image, from among image 
data that has been stored in said second image 
data storage means, and generating edited im- 
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age data representing the edited image on the 
basis of the retrieved image data, which repre- 
sents the images ot at least two frames, and the 
image identification information; and 
edited image data transmitting means for trans- 
mitting the edited image data to said printer 
server in order to print the edited image using 
the edited image data that has been generated. 

100. A computer-readable recording medium storing a 
program for controlling a computer of an image 
server so as to: 

receive information relating to generation of an 
edited image ot one frame generated using im- 
ages of at least two frames from among images 
represented by image data that has been 
stored in said first image data storage means, 
and image identification information for speci- 
fying images of al least two frames lhat were 
used in generation of the edited image; 
retrieve, on the basis of the image identification 
information, image data representing images of 
at least two Irames that were used in generation 
of the edited image, and generate edited image 
data representing the edited image on the basis 
of the retrieved image data, which represents 
the images of at least two frames, and the im- 
age identification information; and 
transmit the edited image data to said printer 
server in order to print the edited image using 
the edited image data that has been generated. 

101 .The image server according to claim 86, 89, 92 or 
98, wherein said image server and said printer serv- 
er constitute a single apparatus. 
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